2023-08-08T01:12:56.783 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T01:12:56.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:12:56.932 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1c61e07ee0>, signals=[15]) 2023-08-08T01:12:56.934 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-08-08T01:12:56.934 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T01:12:56.934 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-08-08T01:12:56.951 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-08-08T01:12:56.951 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T01:12:56.951 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-08-08T01:12:56.953 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-08-08T01:12:56.975 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"} 2023-08-08T01:12:57.023 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-08T01:12:57.044 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-08T01:12:57.065 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-08T01:12:57.065 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 5} 2023-08-08T01:12:57.086 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-08T01:12:57.087 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 5} 2023-08-08T01:12:57.111 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of rhel 8.6 2023-08-08T01:12:57.112 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:12:57.125 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.6 2023-08-08T01:12:57.125 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:12:57.171 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T01:12:57.185 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T01:12:57.218 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-08-08T01:12:57.229 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1} 2023-08-08T01:12:57.275 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:12:57.278 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:12:57.366 INFO:teuthology.orchestra.console.smithi134:Power off 2023-08-08T01:12:57.367 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T01:12:57.382 INFO:teuthology.orchestra.console.smithi114:Power off 2023-08-08T01:12:57.383 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T01:12:57.393 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-08-08T01:12:57.394 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:12:57.405 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-08-08T01:12:57.406 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:12:57.416 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-08T01:12:57.427 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-08-08T01:13:01.420 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:01.429 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:01.532 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-08T01:13:01.539 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-08-08T01:13:05.536 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:05.544 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:05.646 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-08T01:13:05.653 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-08-08T01:13:09.648 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:09.657 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:09.759 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-08T01:13:09.769 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-08-08T01:13:09.861 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-08-08T01:13:09.870 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-08-08T01:13:09.962 INFO:teuthology.orchestra.console.smithi134:Power on 2023-08-08T01:13:09.963 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T01:13:09.971 INFO:teuthology.orchestra.console.smithi114:Power on 2023-08-08T01:13:09.972 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T01:13:09.984 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2023-08-08T01:13:09.984 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:09.994 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2023-08-08T01:13:09.995 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:10.006 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-08T01:13:10.016 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-08-08T01:13:14.008 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:14.017 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:13:14.120 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-08T01:13:14.126 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-08-08T01:13:14.222 INFO:teuthology.orchestra.console.smithi134:Power on completed 2023-08-08T01:13:14.227 INFO:teuthology.orchestra.console.smithi114:Power on completed 2023-08-08T01:13:14.323 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-08-08T01:13:14.323 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:13:14.329 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-08-08T01:13:14.329 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:13:29.396 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:13:29.397 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:13:44.488 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:13:44.490 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:13:59.580 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:13:59.582 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:14:14.665 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:14:14.667 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:14:29.742 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:14:29.743 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:14:44.809 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:14:44.810 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:14:59.872 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:14:59.874 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:15:14.929 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:15:14.931 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:15:29.994 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:15:29.996 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:15:45.056 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:15:45.058 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:16:00.119 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-08-08T01:16:00.122 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-08T01:16:00.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:00.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:03.248 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-08T01:16:03.249 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-08-08T01:16:09.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:09.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:12.304 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-08T01:16:12.305 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-08-08T01:16:18.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:18.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:21.360 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-08T01:16:21.361 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-08-08T01:16:27.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:27.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:30.416 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-08T01:16:30.417 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-08-08T01:16:36.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:36.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:39.472 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-08T01:16:39.473 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-08-08T01:16:45.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:45.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:48.528 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-08-08T01:16:48.529 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-08T01:16:54.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:16:54.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:17:54.592 WARNING:teuthology.provision.fog.smithi114:timed out 2023-08-08T01:17:54.594 WARNING:teuthology.provision.fog.smithi134:timed out 2023-08-08T01:18:00.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:18:00.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:18:00.923 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T01:18:00.924 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T01:18:00.969 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T01:18:00.969 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T01:18:01.201 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-08-08T01:18:01.202 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-08-08T01:18:01.219 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2023-08-08T01:18:01.219 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2023-08-08T01:18:01.258 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-08-08T01:18:01.259 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-08-08T01:18:01.277 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-08-08T01:18:01.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-08-08T01:18:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2023-08-08T01:18:01.280 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2023-08-08T01:18:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2023-08-08T01:18:01.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-08-08T01:18:01.401 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2023-08-08T01:18:01.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-08-08T01:18:01.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2023-08-08T01:18:01.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2023-08-08T01:18:01.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2023-08-08T01:18:01.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2023-08-08T01:18:01.561 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-08-08T01:18:01.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-08-08T01:18:01.626 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-08-08T01:18:01.679 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-08-08T01:18:01.681 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T01:18:01.681 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T01:18:01.681 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-08-08T01:18:01.681 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-08-08T01:18:01.681 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6" 2023-08-08T01:18:01.682 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-08-08T01:18:01.682 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T01:18:01.682 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-08-08T01:18:01.682 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T01:18:01.682 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T01:18:01.682 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T01:18:01.682 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T01:18:01.683 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-08-08T01:18:01.683 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T01:18:01.683 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T01:18:01.683 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T01:18:01.683 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T01:18:01.684 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-08-08T01:18:01.685 DEBUG:teuthology.parallel:result is None 2023-08-08T01:18:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T01:18:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T01:18:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2023-08-08T01:18:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2023-08-08T01:18:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2023-08-08T01:18:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-08-08T01:18:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T01:18:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-08-08T01:18:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T01:18:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T01:18:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T01:18:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T01:18:01.738 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-08-08T01:18:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T01:18:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T01:18:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T01:18:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T01:18:01.739 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-08-08T01:18:01.740 DEBUG:teuthology.parallel:result is None 2023-08-08T01:18:01.905 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-08-08T01:18:01.906 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T01:18:01.931 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2023-08-08T01:18:01.933 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-08-08T01:18:01.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-08-08T01:18:01.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:18:02.000 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-08-08T01:18:02.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-08-08T01:18:02.069 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-08-08T01:18:02.125 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-08-08T01:18:02.125 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-08-08T01:18:02.182 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T01:18:02.183 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T01:18:02.183 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2023-08-08T01:18:02.184 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2023-08-08T01:18:02.184 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2023-08-08T01:18:02.185 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-08-08T01:18:02.185 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T01:18:02.185 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-08-08T01:18:02.186 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T01:18:02.186 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T01:18:02.186 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T01:18:02.186 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T01:18:02.186 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-08-08T01:18:02.186 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T01:18:02.186 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T01:18:02.187 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T01:18:02.187 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T01:18:02.187 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-08-08T01:18:02.205 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2023-08-08T01:18:02.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-08-08T01:18:02.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T01:18:02.270 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-08-08T01:18:02.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-08-08T01:18:02.337 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-08-08T01:18:02.392 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-08-08T01:18:02.392 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-08-08T01:18:02.449 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T01:18:02.449 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T01:18:02.449 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-08-08T01:18:02.449 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-08-08T01:18:02.450 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6" 2023-08-08T01:18:02.450 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-08-08T01:18:02.450 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T01:18:02.450 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-08-08T01:18:02.450 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T01:18:02.450 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T01:18:02.450 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T01:18:02.450 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T01:18:02.451 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-08-08T01:18:02.451 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T01:18:02.451 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T01:18:02.451 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T01:18:02.451 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T01:18:02.452 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-08-08T01:18:02.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:18:02.598 INFO:teuthology.dispatcher.supervisor:Running job 7361187 2023-08-08T01:18:02.598 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361187 --name rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361187/orig.config.yaml 2023-08-08T01:18:02.602 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361187 2023-08-08T01:18:02.603 INFO:teuthology.dispatcher.supervisor:Job PID: 25788 2023-08-08T01:18:02.604 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T01:20:02.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:22:02.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:24:03.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:26:03.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:28:03.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:30:03.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:32:03.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:34:03.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T01:34:03.942 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T01:34:04.148 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T01:34:04.148 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T01:34:04.191 DEBUG:teuthology.nuke:shortname: smithi114 2023-08-08T01:34:04.192 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T01:34:04.212 DEBUG:teuthology.nuke:shortname: smithi134 2023-08-08T01:34:04.213 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T01:34:04.215 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361187', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 01:12:55.902922', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-08T01:34:04.236 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361187', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 01:12:55.904470', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-08T01:34:04.261 INFO:teuthology.orchestra.console.smithi114:Power off 2023-08-08T01:34:04.262 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T01:34:04.279 INFO:teuthology.orchestra.console.smithi134:Power off 2023-08-08T01:34:04.279 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T01:34:04.290 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-08-08T01:34:04.291 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:34:04.303 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-08-08T01:34:04.304 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T01:34:04.315 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-08-08T01:34:04.327 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-08T01:34:04.417 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-08-08T01:34:04.429 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-08-08T01:34:04.564 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2023-08-08T01:34:04.584 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com