2023-09-02T01:17:59.665 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-02T01:17:59.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:17:59.829 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f95f8bc4ee0>, signals=[15]) 2023-09-02T01:17:59.831 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-09-02T01:17:59.831 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:17:59.831 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-02T01:17:59.868 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-09-02T01:17:59.870 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:17:59.871 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-09-02T01:17:59.873 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-09-02T01:17:59.903 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-09-02T01:17:59.962 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-02T01:17:59.971 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-02T01:18:00.004 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-02T01:18:00.005 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 5} 2023-09-02T01:18:00.010 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-02T01:18:00.013 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 5} 2023-09-02T01:18:00.056 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.6 2023-09-02T01:18:00.056 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:18:00.063 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.6 2023-09-02T01:18:00.064 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:18:00.131 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:18:00.145 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:18:00.163 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-09-02T01:18:00.183 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-09-02T01:18:00.217 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:18:00.240 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:18:00.331 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-02T01:18:00.332 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:18:00.349 INFO:teuthology.orchestra.console.smithi183:Power off 2023-09-02T01:18:00.350 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:18:00.360 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-02T01:18:00.361 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:18:00.372 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-09-02T01:18:00.373 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:18:00.385 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-02T01:18:00.394 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-09-02T01:18:00.486 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-02T01:18:00.495 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-09-02T01:18:00.588 INFO:teuthology.orchestra.console.smithi103:Power on 2023-09-02T01:18:00.588 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:18:00.597 INFO:teuthology.orchestra.console.smithi183:Power on 2023-09-02T01:18:00.599 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:18:00.610 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-09-02T01:18:00.610 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:18:00.622 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-09-02T01:18:00.623 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:18:00.633 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-02T01:18:00.645 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-09-02T01:18:04.634 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:18:04.646 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:18:04.747 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-02T01:18:04.757 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-09-02T01:18:08.750 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:18:08.761 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:18:08.863 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-02T01:18:08.875 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-09-02T01:18:08.965 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-09-02T01:18:08.976 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-09-02T01:18:09.066 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-09-02T01:18:09.067 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:18:09.077 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-09-02T01:18:09.078 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:18:24.166 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:18:24.168 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:18:39.262 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:18:39.265 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:18:54.362 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:18:54.364 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:19:09.446 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:19:09.448 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:19:24.550 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:19:24.551 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:19:39.658 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:19:39.660 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:19:54.774 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:19:54.776 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:20:09.894 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:20:09.895 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:20:25.038 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:20:25.040 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:20:40.162 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:20:40.164 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-09-02T01:20:40.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:20:43.322 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-09-02T01:20:49.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:20:52.410 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-09-02T01:20:55.278 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:20:58.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:01.473 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-09-02T01:21:07.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:10.358 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-02T01:21:10.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:10.554 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-09-02T01:21:13.498 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-02T01:21:16.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:19.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:19.642 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-09-02T01:21:22.554 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-02T01:21:25.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:28.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:28.702 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-09-02T01:21:31.642 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-02T01:21:34.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:37.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:37.786 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-09-02T01:21:40.702 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-02T01:21:43.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:46.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:49.786 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-02T01:21:55.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:21:58.842 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-02T01:22:04.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:22:07.902 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-02T01:22:13.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:22:43.830 WARNING:teuthology.provision.fog.smithi183:timed out 2023-09-02T01:22:49.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:22:50.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:22:50.169 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:22:50.443 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-09-02T01:22:50.443 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-09-02T01:22:50.468 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183 2023-09-02T01:22:50.469 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183 /etc/hosts 2023-09-02T01:22:50.527 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-09-02T01:22:50.527 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-09-02T01:22:50.644 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183/smithi183/g' /etc/hosts 2023-09-02T01:22:50.675 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-09-02T01:22:50.746 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183/smithi183/g' /etc/hostname 2023-09-02T01:22:50.814 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-09-02T01:22:50.881 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-09-02T01:22:50.939 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-09-02T01:22:50.939 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2023-09-02T01:22:50.940 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-09-02T01:22:50.940 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-09-02T01:22:50.940 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2023-09-02T01:22:50.940 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:22:50.940 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-02T01:22:50.941 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-09-02T01:22:50.941 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-02T01:22:50.941 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-09-02T01:22:50.942 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-02T01:22:50.942 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:22:50.942 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-09-02T01:22:50.943 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:22:50.943 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-02T01:22:50.943 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-02T01:22:50.943 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-02T01:22:50.944 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-09-02T01:22:50.945 DEBUG:teuthology.parallel:result is None 2023-09-02T01:23:13.930 WARNING:teuthology.provision.fog.smithi103:timed out 2023-09-02T01:23:19.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:23:20.255 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:23:20.256 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:23:20.534 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-09-02T01:23:20.535 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-09-02T01:23:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 2023-09-02T01:23:20.553 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103 /etc/hosts 2023-09-02T01:23:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-09-02T01:23:20.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-02T01:23:20.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103/smithi103/g' /etc/hosts 2023-09-02T01:23:20.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-09-02T01:23:20.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103/smithi103/g' /etc/hostname 2023-09-02T01:23:20.902 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-02T01:23:20.968 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-02T01:23:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-09-02T01:23:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-09-02T01:23:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-09-02T01:23:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-09-02T01:23:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-09-02T01:23:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:23:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-02T01:23:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-09-02T01:23:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-02T01:23:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-09-02T01:23:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-02T01:23:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:23:21.028 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-09-02T01:23:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:23:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-02T01:23:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-02T01:23:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-02T01:23:21.029 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-09-02T01:23:21.030 DEBUG:teuthology.parallel:result is None 2023-09-02T01:23:21.186 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-09-02T01:23:21.187 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:23:21.214 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-09-02T01:23:21.214 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:23:21.231 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:23:21.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-02T01:23:21.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:23:21.296 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-09-02T01:23:21.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-02T01:23:21.362 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-09-02T01:23:21.416 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-09-02T01:23:21.417 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-02T01:23:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-09-02T01:23:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-09-02T01:23:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-09-02T01:23:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-09-02T01:23:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-09-02T01:23:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:23:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-02T01:23:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-09-02T01:23:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-02T01:23:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-09-02T01:23:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-02T01:23:21.474 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:23:21.474 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-09-02T01:23:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:23:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-02T01:23:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-02T01:23:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-02T01:23:21.477 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-02T01:23:21.497 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:23:21.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-09-02T01:23:21.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:23:21.565 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-09-02T01:23:21.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-09-02T01:23:21.697 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-09-02T01:23:21.756 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-09-02T01:23:21.756 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-09-02T01:23:21.814 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-09-02T01:23:21.814 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2023-09-02T01:23:21.815 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-09-02T01:23:21.815 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-09-02T01:23:21.815 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2023-09-02T01:23:21.815 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:23:21.815 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-02T01:23:21.816 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-09-02T01:23:21.816 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-02T01:23:21.817 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-09-02T01:23:21.817 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-02T01:23:21.817 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:23:21.817 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-09-02T01:23:21.817 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:23:21.818 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-02T01:23:21.818 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-02T01:23:21.818 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-02T01:23:21.819 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-09-02T01:23:21.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:23:21.934 INFO:teuthology.dispatcher.supervisor:Running job 7386754 2023-09-02T01:23:21.935 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386754 --name pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} -- /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386754/orig.config.yaml 2023-09-02T01:23:21.939 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386754 2023-09-02T01:23:21.940 INFO:teuthology.dispatcher.supervisor:Job PID: 715211 2023-09-02T01:23:21.940 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-02T01:25:22.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:27:22.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:29:22.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:31:22.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:33:22.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:35:22.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:37:23.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:39:23.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:41:23.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:43:23.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:45:23.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:47:23.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:49:24.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:51:24.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:53:24.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:55:24.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:57:24.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:59:24.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:01:24.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:03:25.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:05:25.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:07:25.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:09:25.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:11:25.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:13:25.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:13:25.969 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-02T02:13:26.113 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-02T02:13:26.114 INFO:teuthology.nuke:Checking targets against current locks 2023-09-02T02:13:26.154 DEBUG:teuthology.nuke:shortname: smithi103 2023-09-02T02:13:26.154 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T02:13:26.177 DEBUG:teuthology.nuke:shortname: smithi183 2023-09-02T02:13:26.178 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T02:13:26.181 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386754', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:17:58.762568', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-02T02:13:26.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386754', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:17:58.764476', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-09-02T02:13:26.218 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-02T02:13:26.218 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T02:13:26.239 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-02T02:13:26.239 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T02:13:26.251 INFO:teuthology.orchestra.console.smithi183:Power off 2023-09-02T02:13:26.251 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T02:13:26.260 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-02T02:13:26.272 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-09-02T02:13:26.273 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T02:13:26.292 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-09-02T02:13:26.362 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-02T02:13:26.393 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-09-02T02:13:26.502 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-09-02T02:13:26.526 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com