2023-07-26T17:58:29.666 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T17:58:29.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T17:58:29.668 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T17:58:29.829 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f85efc62430>, signals=[15]) 2023-07-26T17:58:29.832 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-07-26T17:58:29.832 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T17:58:29.833 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-07-26T17:58:29.857 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2023-07-26T17:58:29.857 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T17:58:29.857 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-07-26T17:58:29.859 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /host {"name": "smithi046"} 2023-07-26T17:58:29.883 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /host {"name": "smithi150"} 2023-07-26T17:58:29.948 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-07-26T17:58:29.958 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-07-26T17:58:29.994 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_rhel_8.4 (ID 7) 2023-07-26T17:58:29.994 DEBUG:teuthology.provision.fog.smithi046:FOG request: PUT /host/151 {"imageID": 7} 2023-07-26T17:58:30.000 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_rhel_8.4 (ID 7) 2023-07-26T17:58:30.001 DEBUG:teuthology.provision.fog.smithi150:FOG request: PUT /host/255 {"imageID": 7} 2023-07-26T17:58:30.062 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of rhel 8.4 2023-07-26T17:58:30.063 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T17:58:30.065 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of rhel 8.4 2023-07-26T17:58:30.066 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T17:58:30.112 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T17:58:30.115 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T17:58:30.156 DEBUG:teuthology.provision.fog.smithi150:FOG request: POST /host/255/task {"taskTypeID": 1} 2023-07-26T17:58:30.159 DEBUG:teuthology.provision.fog.smithi046:FOG request: POST /host/151/task {"taskTypeID": 1} 2023-07-26T17:58:30.213 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T17:58:30.218 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T17:58:30.305 INFO:teuthology.orchestra.console:Power off smithi046 2023-07-26T17:58:30.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T17:58:30.322 INFO:teuthology.orchestra.console:Power off smithi150 2023-07-26T17:58:30.323 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T17:58:30.336 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T17:58:30.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:30.349 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T17:58:30.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:30.362 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T17:58:30.374 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T17:58:34.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:34.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:34.479 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T17:58:34.489 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T17:58:38.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:38.495 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:38.597 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T17:58:38.606 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T17:58:38.698 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2023-07-26T17:58:38.708 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2023-07-26T17:58:38.800 INFO:teuthology.orchestra.console:Power on smithi046 2023-07-26T17:58:38.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T17:58:38.815 INFO:teuthology.orchestra.console:Power on smithi150 2023-07-26T17:58:38.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T17:58:38.832 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T17:58:38.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:38.845 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T17:58:38.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:38.864 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T17:58:38.875 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T17:58:42.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:42.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:42.979 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T17:58:42.989 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T17:58:46.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:46.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T17:58:47.096 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T17:58:47.197 INFO:teuthology.orchestra.console:Power on for smithi046 completed 2023-07-26T17:58:47.213 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T17:58:47.299 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-07-26T17:58:47.299 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T17:58:47.314 INFO:teuthology.orchestra.console:Power on for smithi150 completed 2023-07-26T17:58:47.415 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2023-07-26T17:58:47.416 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T17:59:02.383 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T17:59:02.473 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T17:59:17.468 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T17:59:17.534 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T17:59:32.552 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T17:59:32.594 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T17:59:47.636 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T17:59:47.652 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T18:00:02.708 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T18:00:02.714 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T18:00:17.788 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T18:00:17.790 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T18:00:32.869 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T18:00:32.871 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T18:00:47.941 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T18:00:47.943 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T18:01:03.008 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T18:01:03.009 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T18:01:18.072 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T18:01:18.073 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T18:01:33.141 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-26T18:01:33.142 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-26T18:01:33.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:01:33.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:01:36.272 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-26T18:01:36.273 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-26T18:01:42.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:01:42.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:01:45.328 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-26T18:01:45.329 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-26T18:01:51.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:01:51.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:01:54.384 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-26T18:01:54.385 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-26T18:02:00.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:02:00.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:02:03.441 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-26T18:02:03.441 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-26T18:02:09.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:02:09.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:02:12.499 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-26T18:02:12.528 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-26T18:02:18.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:02:18.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:02:21.584 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-26T18:02:27.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:02:30.672 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-26T18:02:36.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:03:18.548 WARNING:teuthology.provision.fog.smithi046:timed out 2023-07-26T18:03:24.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:03:24.895 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T18:03:24.896 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T18:03:25.177 INFO:teuthology.provision.fog.smithi046:Node is ready 2023-07-26T18:03:25.177 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2023-07-26T18:03:25.192 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2023-07-26T18:03:25.192 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2023-07-26T18:03:25.248 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-07-26T18:03:25.248 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-07-26T18:03:25.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2023-07-26T18:03:25.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2023-07-26T18:03:25.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2023-07-26T18:03:25.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-07-26T18:03:25.600 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-07-26T18:03:25.659 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-07-26T18:03:25.660 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.4 (Ootpa)" 2023-07-26T18:03:25.660 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-07-26T18:03:25.660 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-07-26T18:03:25.660 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.4" 2023-07-26T18:03:25.660 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-07-26T18:03:25.660 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-26T18:03:25.661 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-07-26T18:03:25.661 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-26T18:03:25.661 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-07-26T18:03:25.661 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-26T18:03:25.661 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T18:03:25.661 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-26T18:03:25.663 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T18:03:25.663 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-26T18:03:25.663 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-26T18:03:25.663 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-26T18:03:25.664 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2023-07-26T18:03:25.665 DEBUG:teuthology.parallel:result is None 2023-07-26T18:03:36.692 WARNING:teuthology.provision.fog.smithi150:timed out 2023-07-26T18:03:42.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:03:43.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T18:03:43.079 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T18:03:43.319 INFO:teuthology.provision.fog.smithi150:Node is ready 2023-07-26T18:03:43.320 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2023-07-26T18:03:43.376 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2023-07-26T18:03:43.376 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2023-07-26T18:03:43.433 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2023-07-26T18:03:43.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2023-07-26T18:03:43.544 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2023-07-26T18:03:43.571 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2023-07-26T18:03:43.636 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2023-07-26T18:03:43.701 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2023-07-26T18:03:43.765 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-07-26T18:03:43.820 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2023-07-26T18:03:43.820 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.4 (Ootpa)" 2023-07-26T18:03:43.821 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2023-07-26T18:03:43.821 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2023-07-26T18:03:43.821 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.4" 2023-07-26T18:03:43.821 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2023-07-26T18:03:43.822 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-26T18:03:43.822 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-07-26T18:03:43.822 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-26T18:03:43.823 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2023-07-26T18:03:43.823 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-26T18:03:43.823 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T18:03:43.823 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-26T18:03:43.823 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T18:03:43.823 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-26T18:03:43.824 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-26T18:03:43.824 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-26T18:03:43.824 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2023-07-26T18:03:43.825 DEBUG:teuthology.parallel:result is None 2023-07-26T18:03:43.996 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2023-07-26T18:03:43.997 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T18:03:44.027 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2023-07-26T18:03:44.027 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T18:03:44.054 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2023-07-26T18:03:44.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-07-26T18:03:44.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:03:44.129 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-07-26T18:03:44.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-07-26T18:03:44.257 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-07-26T18:03:44.315 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-07-26T18:03:44.315 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-07-26T18:03:44.371 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-07-26T18:03:44.372 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.4 (Ootpa)" 2023-07-26T18:03:44.372 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-07-26T18:03:44.372 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-07-26T18:03:44.372 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.4" 2023-07-26T18:03:44.372 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-07-26T18:03:44.373 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-26T18:03:44.373 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-07-26T18:03:44.373 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-26T18:03:44.373 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-07-26T18:03:44.373 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-26T18:03:44.373 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T18:03:44.373 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-07-26T18:03:44.374 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T18:03:44.374 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-26T18:03:44.374 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-26T18:03:44.374 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-26T18:03:44.374 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-07-26T18:03:44.393 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2023-07-26T18:03:44.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-26T18:03:44.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T18:03:44.461 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-07-26T18:03:44.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-26T18:03:44.522 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-07-26T18:03:44.576 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-07-26T18:03:44.576 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-07-26T18:03:44.630 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2023-07-26T18:03:44.630 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.4 (Ootpa)" 2023-07-26T18:03:44.630 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2023-07-26T18:03:44.630 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2023-07-26T18:03:44.630 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.4" 2023-07-26T18:03:44.631 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2023-07-26T18:03:44.631 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-26T18:03:44.631 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-07-26T18:03:44.631 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-26T18:03:44.631 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2023-07-26T18:03:44.631 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-26T18:03:44.632 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T18:03:44.632 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-07-26T18:03:44.633 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T18:03:44.633 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-26T18:03:44.633 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-26T18:03:44.634 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-26T18:03:44.634 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-07-26T18:03:44.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:03:44.661 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:03:44.765 INFO:teuthology.dispatcher.supervisor:Running job 7352399 2023-07-26T18:03:44.765 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-25_21:35:32-rados-wip-yuri8-testing-2023-07-24-0819-quincy-distro-default-smithi/7352399 --name yuriw-2023-07-25_21:35:32-rados-wip-yuri8-testing-2023-07-24-0819-quincy-distro-default-smithi --description rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/yuriw-2023-07-25_21:35:32-rados-wip-yuri8-testing-2023-07-24-0819-quincy-distro-default-smithi/7352399/orig.config.yaml 2023-07-26T18:03:44.769 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-25_21:35:32-rados-wip-yuri8-testing-2023-07-24-0819-quincy-distro-default-smithi/7352399 2023-07-26T18:03:44.770 INFO:teuthology.dispatcher.supervisor:Job PID: 6747 2023-07-26T18:03:44.770 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-26T18:05:44.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:05:44.870 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:07:45.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:07:45.051 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:09:45.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:09:45.234 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:11:45.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:11:45.403 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:13:45.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:13:45.577 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:15:45.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:15:45.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:17:45.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:17:45.951 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:19:46.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:19:46.134 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:21:46.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:21:46.310 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:23:46.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T18:23:46.490 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T18:23:46.564 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-26T18:23:46.712 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-26T18:23:46.713 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T18:23:46.770 DEBUG:teuthology.nuke:shortname: smithi046 2023-07-26T18:23:46.770 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T18:23:46.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_21:35:32-rados-wip-yuri8-testing-2023-07-24-0819-quincy-distro-default-smithi/7352399', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 17:58:28.834298', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo46sLl2VSVi/YeXI5gEj2Y9s1XMfXk5YsK1ODPyH4ab3A9QhoLNfhk8x2goHeLgV5jfpS7W8bC8viQQMVR8RVfJMxyQGhFwGw5ykMYncvyz5O+Imuz3QSEKEpvufyGQHplr6KqhGiLFIHTxA4u7tGMkVKzMqUsLgsRnnqd/9n8j0wGncw/BTbHQwGT3zaQilFtZYoDeZde+esLlaBjJ7pKA2bGQCVMy3XDnvOXR6KRXLFb5X0NelSTnVIsqziAAUeiePsYlBxRUfYCA/3pKH21J1Mo//YBbeIU8v+4271C4d6AAJwQAaTrNDKnfRF5Z5gBnjVObD3hjeX38aKCFphUz3HtVhmJYXHraIl9CdxZ0ZzusayNTinh1CSJIIL1RiZSFQNPxGDb90IdEctnAhzZPFoOUgv1xSsjIDjhJiN0zz8KvcNQCzrK48mqS+DzqhOGGLINLKF2cBOinboYIaxcSLMm/vQ7H8wHt1cHAGjFtb9r1wBfey/b88p3AWLrXk='} 2023-07-26T18:23:46.799 DEBUG:teuthology.nuke:shortname: smithi150 2023-07-26T18:23:46.799 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T18:23:46.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_21:35:32-rados-wip-yuri8-testing-2023-07-24-0819-quincy-distro-default-smithi/7352399', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 17:58:28.836355', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyNucq+CvyeklMPS2Jl+6KSYa5Kw68YZQqpdR5EjlDXnb28ARVEurPa3WG5JRcaxtE5Om2fRDtf7zcNs62/O6A='} 2023-07-26T18:23:46.863 INFO:teuthology.orchestra.console:Power off smithi046 2023-07-26T18:23:46.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T18:23:46.882 INFO:teuthology.orchestra.console:Power off smithi150 2023-07-26T18:23:46.883 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T18:23:46.896 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T18:23:46.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T18:23:46.908 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T18:23:46.909 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T18:23:46.919 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T18:23:46.935 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T18:23:47.021 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2023-07-26T18:23:47.036 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2023-07-26T18:23:47.188 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2023-07-26T18:23:47.199 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com