2023-10-06T11:22:50.259 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T11:22:50.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:22:50.390 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8746d4d670>, signals=[15]) 2023-10-06T11:22:50.391 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2023-10-06T11:22:50.391 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T11:22:50.391 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-10-06T11:22:50.412 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2023-10-06T11:22:50.412 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T11:22:50.412 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-10-06T11:22:50.413 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /host {"name": "smithi016"} 2023-10-06T11:22:50.436 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /host {"name": "smithi177"} 2023-10-06T11:22:50.484 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-06T11:22:50.505 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-06T11:22:50.534 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-06T11:22:50.534 DEBUG:teuthology.provision.fog.smithi016:FOG request: PUT /host/122 {"imageID": 7} 2023-10-06T11:22:50.552 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-06T11:22:50.552 DEBUG:teuthology.provision.fog.smithi177:FOG request: PUT /host/282 {"imageID": 7} 2023-10-06T11:22:50.591 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of rhel 8.4 2023-10-06T11:22:50.591 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:22:50.593 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 8.4 2023-10-06T11:22:50.594 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:22:50.645 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T11:22:50.648 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T11:22:50.686 DEBUG:teuthology.provision.fog.smithi016:FOG request: POST /host/122/task {"taskTypeID": 1} 2023-10-06T11:22:50.689 DEBUG:teuthology.provision.fog.smithi177:FOG request: POST /host/282/task {"taskTypeID": 1} 2023-10-06T11:22:50.735 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:22:50.738 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:22:50.823 INFO:teuthology.orchestra.console.smithi177:Power off 2023-10-06T11:22:50.823 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:22:50.836 INFO:teuthology.orchestra.console.smithi016:Power off 2023-10-06T11:22:50.836 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:22:50.845 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-10-06T11:22:50.846 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:50.857 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-10-06T11:22:50.857 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:50.868 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-10-06T11:22:50.879 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-10-06T11:22:54.872 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:54.880 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:54.981 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-10-06T11:22:54.988 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-10-06T11:22:58.984 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:58.990 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:59.093 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-10-06T11:22:59.098 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-10-06T11:22:59.198 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-10-06T11:22:59.299 INFO:teuthology.orchestra.console.smithi016:Power on 2023-10-06T11:22:59.299 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T11:22:59.320 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On 2023-10-06T11:22:59.320 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:59.341 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-10-06T11:23:03.094 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:23:03.202 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-10-06T11:23:03.303 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-10-06T11:23:03.342 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:23:03.404 INFO:teuthology.orchestra.console.smithi177:Power on 2023-10-06T11:23:03.404 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T11:23:03.425 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2023-10-06T11:23:03.425 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:23:03.451 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-10-06T11:23:03.472 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-10-06T11:23:07.454 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:23:07.473 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:23:07.562 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-10-06T11:23:07.581 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-10-06T11:23:07.663 INFO:teuthology.orchestra.console.smithi016:Power on completed 2023-10-06T11:23:07.681 INFO:teuthology.orchestra.console.smithi177:Power on completed 2023-10-06T11:23:07.764 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2023-10-06T11:23:07.764 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:23:07.782 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2023-10-06T11:23:07.782 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:23:22.843 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:23:22.846 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:23:37.910 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:23:37.911 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:23:52.981 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:23:52.982 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:24:08.050 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:24:08.051 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:24:23.122 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:24:23.123 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:24:38.198 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:24:38.200 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:24:53.278 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:24:53.279 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:25:08.366 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:25:08.367 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:25:23.455 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:25:23.456 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:25:38.538 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:25:38.539 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None 2023-10-06T11:25:38.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:25:53.622 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-10-06T11:25:53.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:25:56.986 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-10-06T11:26:02.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:06.042 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-10-06T11:26:12.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:12.094 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-06T11:26:15.098 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-10-06T11:26:18.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:21.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:21.182 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-06T11:26:24.154 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-10-06T11:26:27.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:30.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:30.266 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-06T11:26:36.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:39.326 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-06T11:26:45.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:48.798 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-06T11:26:54.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:27:30.196 WARNING:teuthology.provision.fog.smithi016:timed out 2023-10-06T11:27:36.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:27:36.500 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T11:27:36.500 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T11:27:36.724 INFO:teuthology.provision.fog.smithi016:Node is ready 2023-10-06T11:27:36.724 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2023-10-06T11:27:36.740 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2023-10-06T11:27:36.740 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2023-10-06T11:27:36.796 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2023-10-06T11:27:36.797 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-10-06T11:27:36.908 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2023-10-06T11:27:36.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2023-10-06T11:27:37.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2023-10-06T11:27:37.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-10-06T11:27:37.131 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-10-06T11:27:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T11:27:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.4" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:27:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-10-06T11:27:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T11:27:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T11:27:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T11:27:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T11:27:37.188 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2023-10-06T11:27:37.190 DEBUG:teuthology.parallel:result is None 2023-10-06T11:27:54.938 WARNING:teuthology.provision.fog.smithi177:timed out 2023-10-06T11:28:00.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:28:01.269 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T11:28:01.269 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T11:28:01.535 INFO:teuthology.provision.fog.smithi177:Node is ready 2023-10-06T11:28:01.535 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2023-10-06T11:28:01.592 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2023-10-06T11:28:01.592 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2023-10-06T11:28:01.648 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2023-10-06T11:28:01.648 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-10-06T11:28:01.759 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2023-10-06T11:28:01.786 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2023-10-06T11:28:01.851 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2023-10-06T11:28:01.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-10-06T11:28:01.978 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-10-06T11:28:02.033 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T11:28:02.033 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T11:28:02.033 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel" 2023-10-06T11:28:02.033 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora" 2023-10-06T11:28:02.033 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.4" 2023-10-06T11:28:02.033 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-10-06T11:28:02.033 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T11:28:02.034 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T11:28:02.035 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2023-10-06T11:28:02.035 DEBUG:teuthology.parallel:result is None 2023-10-06T11:28:02.181 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2023-10-06T11:28:02.182 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T11:28:02.208 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2023-10-06T11:28:02.209 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T11:28:02.226 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2023-10-06T11:28:02.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-10-06T11:28:02.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:28:02.295 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-10-06T11:28:02.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-10-06T11:28:02.417 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-10-06T11:28:02.473 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-10-06T11:28:02.473 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.4" 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-10-06T11:28:02.529 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T11:28:02.530 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T11:28:02.530 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T11:28:02.530 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:28:02.530 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-10-06T11:28:02.530 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T11:28:02.530 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T11:28:02.530 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T11:28:02.530 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T11:28:02.531 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-10-06T11:28:02.550 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2023-10-06T11:28:02.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-06T11:28:02.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:28:02.615 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-10-06T11:28:02.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-06T11:28:02.680 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-10-06T11:28:02.734 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-10-06T11:28:02.734 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-10-06T11:28:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T11:28:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T11:28:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel" 2023-10-06T11:28:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora" 2023-10-06T11:28:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.4" 2023-10-06T11:28:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-10-06T11:28:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T11:28:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T11:28:02.790 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-10-06T11:28:02.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:28:02.901 INFO:teuthology.dispatcher.supervisor:Running job 7412417 2023-10-06T11:28:02.901 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412417 --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412417/orig.config.yaml 2023-10-06T11:28:02.905 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412417 2023-10-06T11:28:02.905 INFO:teuthology.dispatcher.supervisor:Job PID: 1589481 2023-10-06T11:28:02.905 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-06T11:30:03.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:32:03.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:34:03.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:36:03.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:38:03.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:40:03.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:42:03.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:44:04.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:44:04.195 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-06T11:44:04.380 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-06T11:44:04.380 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T11:44:04.418 DEBUG:teuthology.nuke:shortname: smithi016 2023-10-06T11:44:04.418 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:44:04.440 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:22:49.413416', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETzpEEBd5S9AGT46sVfXh0CmuWgCfE2KYq3uvkh21YMtkyX3fg8MjFIIC2e1shdrgADEeMosd/3XxXSmLp/6sY='} 2023-10-06T11:44:04.443 DEBUG:teuthology.nuke:shortname: smithi177 2023-10-06T11:44:04.443 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:44:04.464 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:22:49.414813', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOOHDdXoRoHZfnCPeoRS4nfiBlTkz0J5rsDHjszoMelrS3lw0SWeqNkRoWAXZuJv2SwvFbAftTTP/wEmA2FuoN0='} 2023-10-06T11:44:04.489 INFO:teuthology.orchestra.console.smithi016:Power off 2023-10-06T11:44:04.489 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:44:04.509 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-10-06T11:44:04.509 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:44:04.522 INFO:teuthology.orchestra.console.smithi177:Power off 2023-10-06T11:44:04.522 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:44:04.531 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-10-06T11:44:04.542 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-10-06T11:44:04.542 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:44:04.563 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-10-06T11:44:04.632 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-10-06T11:44:04.664 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-10-06T11:44:04.789 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2023-10-06T11:44:04.811 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com