2023-10-05T07:09:58.816 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T07:09:58.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:09:58.958 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6170368670>, signals=[15]) 2023-10-05T07:09:58.959 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-10-05T07:09:58.959 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T07:09:58.959 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-10-05T07:09:58.984 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-10-05T07:09:58.985 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T07:09:58.985 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-05T07:09:58.986 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"} 2023-10-05T07:09:59.009 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /host {"name": "smithi135"} 2023-10-05T07:09:59.064 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-05T07:09:59.074 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-05T07:09:59.114 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-05T07:09:59.114 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 7} 2023-10-05T07:09:59.119 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-05T07:09:59.119 DEBUG:teuthology.provision.fog.smithi135:FOG request: PUT /host/240 {"imageID": 7} 2023-10-05T07:09:59.152 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.4 2023-10-05T07:09:59.152 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:09:59.168 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of rhel 8.4 2023-10-05T07:09:59.168 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:09:59.223 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T07:09:59.231 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T07:09:59.270 DEBUG:teuthology.provision.fog.smithi135:FOG request: POST /host/240/task {"taskTypeID": 1} 2023-10-05T07:09:59.272 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1} 2023-10-05T07:09:59.318 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:09:59.326 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:09:59.430 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-05T07:09:59.431 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T07:09:59.442 INFO:teuthology.orchestra.console.smithi134:Power off 2023-10-05T07:09:59.443 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T07:09:59.451 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-05T07:09:59.452 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:09:59.462 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-10-05T07:09:59.462 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:09:59.471 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-05T07:09:59.483 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-10-05T07:09:59.572 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-05T07:09:59.584 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-10-05T07:09:59.673 INFO:teuthology.orchestra.console.smithi135:Power on 2023-10-05T07:09:59.674 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T07:09:59.685 INFO:teuthology.orchestra.console.smithi134:Power on 2023-10-05T07:09:59.686 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T07:09:59.695 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-10-05T07:09:59.695 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:09:59.705 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2023-10-05T07:09:59.706 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:09:59.725 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-10-05T07:09:59.727 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-05T07:10:03.726 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:10:03.733 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:10:03.834 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-10-05T07:10:03.841 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-05T07:10:07.841 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:10:07.848 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:10:07.950 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-10-05T07:10:07.956 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-05T07:10:08.051 INFO:teuthology.orchestra.console.smithi134:Power on completed 2023-10-05T07:10:08.057 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-10-05T07:10:08.152 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-10-05T07:10:08.153 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:10:08.158 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-10-05T07:10:08.158 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:10:23.254 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:10:23.255 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:10:38.342 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:10:38.344 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:10:53.441 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:10:53.443 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:11:08.516 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:11:08.518 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:11:23.614 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:11:23.615 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:11:38.706 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:11:38.707 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:11:53.798 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:11:53.799 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:12:08.890 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:12:08.891 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:12:23.970 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:12:23.972 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:12:39.042 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:12:39.043 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:12:54.110 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-10-05T07:12:54.112 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-10-05T07:12:54.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:12:54.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:13:12.574 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-05T07:13:12.575 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-10-05T07:13:18.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:13:18.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:13:21.662 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-05T07:13:21.663 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-10-05T07:13:27.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:13:27.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:13:30.746 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-05T07:13:30.747 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-10-05T07:13:36.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:13:36.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:13:39.806 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-05T07:13:39.807 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-10-05T07:13:45.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:13:45.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:14:45.870 WARNING:teuthology.provision.fog.smithi135:timed out 2023-10-05T07:14:45.871 WARNING:teuthology.provision.fog.smithi134:timed out 2023-10-05T07:14:51.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:14:51.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:14:52.188 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T07:14:52.189 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T07:14:52.220 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T07:14:52.220 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T07:14:52.469 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-10-05T07:14:52.469 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-10-05T07:14:52.505 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-10-05T07:14:52.505 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-10-05T07:14:52.520 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2023-10-05T07:14:52.520 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2023-10-05T07:14:52.524 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2023-10-05T07:14:52.525 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2023-10-05T07:14:52.577 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-10-05T07:14:52.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-10-05T07:14:52.582 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-10-05T07:14:52.582 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-10-05T07:14:52.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2023-10-05T07:14:52.697 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2023-10-05T07:14:52.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-10-05T07:14:52.722 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-10-05T07:14:52.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2023-10-05T07:14:52.787 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2023-10-05T07:14:52.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-10-05T07:14:52.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-10-05T07:14:52.903 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-10-05T07:14:52.915 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-05T07:14:52.957 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T07:14:52.957 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T07:14:52.957 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-10-05T07:14:52.957 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-10-05T07:14:52.957 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.4" 2023-10-05T07:14:52.957 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-10-05T07:14:52.958 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T07:14:52.958 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-10-05T07:14:52.958 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T07:14:52.958 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T07:14:52.958 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T07:14:52.958 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T07:14:52.958 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-05T07:14:52.959 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T07:14:52.959 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T07:14:52.959 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T07:14:52.959 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T07:14:52.959 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-10-05T07:14:52.961 DEBUG:teuthology.parallel:result is None 2023-10-05T07:14:52.974 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.4" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T07:14:52.975 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T07:14:52.976 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T07:14:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T07:14:52.976 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T07:14:52.976 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T07:14:52.976 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T07:14:52.976 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T07:14:52.977 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-10-05T07:14:52.977 DEBUG:teuthology.parallel:result is None 2023-10-05T07:14:53.128 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2023-10-05T07:14:53.128 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T07:14:53.144 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-10-05T07:14:53.144 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T07:14:53.170 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2023-10-05T07:14:53.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-10-05T07:14:53.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:14:53.234 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-10-05T07:14:53.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-10-05T07:14:53.296 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-10-05T07:14:53.349 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-10-05T07:14:53.349 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.4" 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-10-05T07:14:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T07:14:53.405 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T07:14:53.405 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T07:14:53.405 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T07:14:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-10-05T07:14:53.405 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T07:14:53.405 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T07:14:53.405 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T07:14:53.405 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T07:14:53.406 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-10-05T07:14:53.427 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-10-05T07:14:53.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-05T07:14:53.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T07:14:53.491 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-10-05T07:14:53.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-05T07:14:53.560 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-10-05T07:14:53.615 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-10-05T07:14:53.615 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.4" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T07:14:53.669 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T07:14:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T07:14:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T07:14:53.670 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-05T07:14:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T07:14:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T07:14:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T07:14:53.670 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T07:14:53.670 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-05T07:14:53.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:14:53.786 INFO:teuthology.dispatcher.supervisor:Running job 7411079 2023-10-05T07:14:53.786 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411079 --name yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} -- /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411079/orig.config.yaml 2023-10-05T07:14:53.790 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411079 2023-10-05T07:14:53.790 INFO:teuthology.dispatcher.supervisor:Job PID: 2792522 2023-10-05T07:14:53.791 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-05T07:16:53.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:18:54.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:20:54.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:22:54.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:24:54.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:26:54.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:28:54.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:30:55.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:32:55.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:34:55.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T07:34:55.478 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-05T07:34:55.586 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-05T07:34:55.586 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T07:34:55.638 DEBUG:teuthology.nuke:shortname: smithi134 2023-10-05T07:34:55.639 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T07:34:55.659 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 07:09:58.017983', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNG9Up16X123f5mHBrrIPe62v7plPerfP/HOrxkk9aGWOEVbycB99tvrfLkQ63ZwenUraQ19ho2npuFLPzou2qk='} 2023-10-05T07:34:55.662 DEBUG:teuthology.nuke:shortname: smithi135 2023-10-05T07:34:55.663 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T07:34:55.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 07:09:58.019649', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWUOT/UmHtWRR+IK1o3BApIamzz8dWpaXyOk2vwrD10fJ4gsZJCNuR9SZuh34E7uigjrrohPIJqz+O8319GRo4='} 2023-10-05T07:34:55.711 INFO:teuthology.orchestra.console.smithi134:Power off 2023-10-05T07:34:55.711 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T07:34:55.731 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-10-05T07:34:55.731 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:34:55.748 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-05T07:34:55.748 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T07:34:55.756 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-10-05T07:34:55.768 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-05T07:34:55.769 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T07:34:55.790 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-05T07:34:55.856 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-10-05T07:34:55.891 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-05T07:34:56.012 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2023-10-05T07:34:56.044 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com