2023-08-10T03:24:10.101 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T03:24:10.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:24:10.236 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1105a48f70>, signals=[15]) 2023-08-10T03:24:10.238 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-08-10T03:24:10.239 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T03:24:10.239 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-08-10T03:24:10.268 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-08-10T03:24:10.268 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T03:24:10.269 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-08-10T03:24:10.270 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"} 2023-08-10T03:24:10.293 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"} 2023-08-10T03:24:10.354 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-10T03:24:10.357 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-10T03:24:10.394 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-10T03:24:10.395 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 5} 2023-08-10T03:24:10.398 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-10T03:24:10.398 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 5} 2023-08-10T03:24:10.439 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.6 2023-08-10T03:24:10.440 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:24:10.445 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of rhel 8.6 2023-08-10T03:24:10.445 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:24:10.494 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T03:24:10.506 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T03:24:10.528 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1} 2023-08-10T03:24:10.536 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1} 2023-08-10T03:24:10.579 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:24:10.589 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:24:10.680 INFO:teuthology.orchestra.console.smithi154:Power off 2023-08-10T03:24:10.682 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:24:10.699 INFO:teuthology.orchestra.console.smithi134:Power off 2023-08-10T03:24:10.700 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:24:10.709 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-08-10T03:24:10.710 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:24:10.722 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-08-10T03:24:10.722 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:24:10.733 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-08-10T03:24:10.745 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-10T03:24:10.834 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-08-10T03:24:10.846 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-08-10T03:24:10.936 INFO:teuthology.orchestra.console.smithi154:Power on 2023-08-10T03:24:10.936 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T03:24:10.947 INFO:teuthology.orchestra.console.smithi134:Power on 2023-08-10T03:24:10.948 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T03:24:10.961 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2023-08-10T03:24:10.961 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:24:10.971 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2023-08-10T03:24:10.972 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:24:10.982 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-08-10T03:24:10.994 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-10T03:24:14.984 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:24:14.995 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:24:15.094 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-08-10T03:24:15.105 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-10T03:24:15.206 INFO:teuthology.orchestra.console.smithi134:Power on completed 2023-08-10T03:24:15.307 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-08-10T03:24:15.307 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:24:19.099 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:24:19.209 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-08-10T03:24:19.310 INFO:teuthology.orchestra.console.smithi154:Power on completed 2023-08-10T03:24:19.411 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-08-10T03:24:19.411 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:24:30.388 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:24:34.500 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:24:45.477 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:24:49.560 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:25:00.556 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:25:04.631 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:25:15.645 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:25:19.712 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:25:30.724 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:25:34.776 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:25:45.811 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:25:49.877 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:26:00.888 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:26:04.940 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:26:15.970 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:26:20.017 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:26:31.050 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:26:35.082 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:26:46.116 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:26:50.148 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:27:01.180 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-10T03:27:01.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:04.304 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-10T03:27:05.203 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-08-10T03:27:05.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:08.336 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-10T03:27:10.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:13.360 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-10T03:27:14.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:17.392 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-10T03:27:19.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:22.416 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-10T03:27:23.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:26.452 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-10T03:27:28.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:31.476 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-10T03:27:32.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:35.508 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-10T03:27:37.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:40.560 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-10T03:27:41.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:44.564 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-10T03:27:46.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:49.620 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-10T03:27:50.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:53.616 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-10T03:27:55.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:27:59.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:28:02.672 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-10T03:28:08.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:28:11.728 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-08-10T03:28:17.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:28:55.660 WARNING:teuthology.provision.fog.smithi134:timed out 2023-08-10T03:29:01.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:29:01.999 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T03:29:02.000 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T03:29:02.275 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-08-10T03:29:02.276 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-08-10T03:29:02.292 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2023-08-10T03:29:02.293 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2023-08-10T03:29:02.350 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-08-10T03:29:02.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-08-10T03:29:02.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2023-08-10T03:29:02.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-08-10T03:29:02.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2023-08-10T03:29:02.623 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-08-10T03:29:02.688 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-08-10T03:29:02.744 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T03:29:02.744 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T03:29:02.744 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-08-10T03:29:02.745 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-08-10T03:29:02.745 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6" 2023-08-10T03:29:02.745 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:29:02.745 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T03:29:02.745 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-08-10T03:29:02.745 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T03:29:02.745 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T03:29:02.746 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T03:29:02.746 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:29:02.746 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-08-10T03:29:02.746 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:29:02.746 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T03:29:02.746 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T03:29:02.746 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T03:29:02.747 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-08-10T03:29:02.748 DEBUG:teuthology.parallel:result is None 2023-08-10T03:29:17.749 WARNING:teuthology.provision.fog.smithi154:timed out 2023-08-10T03:29:23.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:29:24.098 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T03:29:24.099 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T03:29:24.354 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-08-10T03:29:24.355 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-08-10T03:29:24.412 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-08-10T03:29:24.413 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2023-08-10T03:29:24.468 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-08-10T03:29:24.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-08-10T03:29:24.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2023-08-10T03:29:24.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-08-10T03:29:24.692 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2023-08-10T03:29:24.759 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-08-10T03:29:24.825 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-08-10T03:29:24.879 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T03:29:24.879 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T03:29:24.879 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2023-08-10T03:29:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2023-08-10T03:29:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2023-08-10T03:29:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:29:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T03:29:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-08-10T03:29:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T03:29:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T03:29:24.881 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T03:29:24.881 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:29:24.881 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-08-10T03:29:24.881 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:29:24.881 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T03:29:24.881 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T03:29:24.881 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T03:29:24.882 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-08-10T03:29:24.883 DEBUG:teuthology.parallel:result is None 2023-08-10T03:29:25.024 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2023-08-10T03:29:25.025 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-08-10T03:29:25.027 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2023-08-10T03:29:25.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-08-10T03:29:25.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:29:25.093 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-08-10T03:29:25.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-08-10T03:29:25.226 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-08-10T03:29:25.283 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-08-10T03:29:25.283 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-08-10T03:29:25.339 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T03:29:25.340 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T03:29:25.340 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-08-10T03:29:25.340 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-08-10T03:29:25.340 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6" 2023-08-10T03:29:25.340 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:29:25.341 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T03:29:25.341 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-08-10T03:29:25.341 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T03:29:25.341 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T03:29:25.342 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T03:29:25.342 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:29:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-08-10T03:29:25.342 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:29:25.342 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T03:29:25.343 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T03:29:25.343 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T03:29:25.343 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-08-10T03:29:25.365 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-08-10T03:29:25.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-08-10T03:29:25.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T03:29:25.428 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-08-10T03:29:25.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-08-10T03:29:25.495 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-08-10T03:29:25.552 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-08-10T03:29:25.553 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-08-10T03:29:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T03:29:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T03:29:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2023-08-10T03:29:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2023-08-10T03:29:25.610 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2023-08-10T03:29:25.611 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-08-10T03:29:25.611 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T03:29:25.611 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-08-10T03:29:25.611 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T03:29:25.611 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T03:29:25.611 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T03:29:25.611 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T03:29:25.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-08-10T03:29:25.612 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T03:29:25.612 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T03:29:25.612 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T03:29:25.612 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T03:29:25.613 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-08-10T03:29:25.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:29:25.727 INFO:teuthology.dispatcher.supervisor:Running job 7362308 2023-08-10T03:29:25.727 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362308 --name amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362308/orig.config.yaml 2023-08-10T03:29:25.730 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362308 2023-08-10T03:29:25.731 INFO:teuthology.dispatcher.supervisor:Job PID: 3978 2023-08-10T03:29:25.731 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-10T03:31:25.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:33:26.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:35:26.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:37:26.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:39:26.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:41:26.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:43:26.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:45:26.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T03:45:27.041 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-10T03:45:27.193 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-10T03:45:27.193 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T03:45:27.245 DEBUG:teuthology.nuke:shortname: smithi134 2023-08-10T03:45:27.245 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T03:45:27.266 DEBUG:teuthology.nuke:shortname: smithi154 2023-08-10T03:45:27.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T03:45:27.269 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362308', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 03:24:09.290155', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-10T03:45:27.289 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362308', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 03:24:09.291663', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-10T03:45:27.323 INFO:teuthology.orchestra.console.smithi134:Power off 2023-08-10T03:45:27.324 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:45:27.345 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-08-10T03:45:27.346 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:45:27.364 INFO:teuthology.orchestra.console.smithi154:Power off 2023-08-10T03:45:27.365 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T03:45:27.376 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-10T03:45:27.390 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-08-10T03:45:27.390 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T03:45:27.414 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-08-10T03:45:27.477 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-08-10T03:45:27.516 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-08-10T03:45:27.623 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2023-08-10T03:45:27.665 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com