2023-09-15T16:33:54.650 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-15T16:33:54.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:33:54.795 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdadf4fec10>, signals=[15]) 2023-09-15T16:33:54.796 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2023-09-15T16:33:54.797 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2023-09-15T16:33:54.797 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-09-15T16:33:54.816 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-09-15T16:33:54.816 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-09-15T16:33:54.816 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-09-15T16:33:54.818 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"} 2023-09-15T16:33:54.841 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"} 2023-09-15T16:33:54.895 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-15T16:33:54.907 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-15T16:33:54.947 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_8.stream (ID 3) 2023-09-15T16:33:54.947 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 3} 2023-09-15T16:33:54.950 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_8.stream (ID 3) 2023-09-15T16:33:54.951 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 3} 2023-09-15T16:33:55.001 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream 2023-09-15T16:33:55.002 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:33:55.005 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.stream 2023-09-15T16:33:55.006 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:33:55.049 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"} 2023-09-15T16:33:55.065 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"} 2023-09-15T16:33:55.082 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1} 2023-09-15T16:33:55.103 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1} 2023-09-15T16:33:55.138 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:33:55.159 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:33:55.218 INFO:teuthology.orchestra.console.smithi096:Power off 2023-09-15T16:33:55.219 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T16:33:55.231 INFO:teuthology.orchestra.console.smithi143:Power off 2023-09-15T16:33:55.231 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T16:33:55.239 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-09-15T16:33:55.239 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:33:55.251 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-09-15T16:33:55.251 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:33:55.260 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-15T16:33:55.271 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-15T16:33:55.360 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-09-15T16:33:55.372 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-09-15T16:33:55.462 INFO:teuthology.orchestra.console.smithi096:Power on 2023-09-15T16:33:55.462 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-15T16:33:55.474 INFO:teuthology.orchestra.console.smithi143:Power on 2023-09-15T16:33:55.474 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-15T16:33:55.482 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On 2023-09-15T16:33:55.483 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:33:55.498 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-09-15T16:33:55.499 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:33:55.508 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-15T16:33:55.519 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-15T16:33:59.510 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:33:59.521 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:33:59.621 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-15T16:33:59.630 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-15T16:34:03.626 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:34:03.634 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:34:03.743 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-09-15T16:34:03.746 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-15T16:34:03.844 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-09-15T16:34:03.847 INFO:teuthology.orchestra.console.smithi096:Power on completed 2023-09-15T16:34:03.945 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-09-15T16:34:03.946 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:34:03.949 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2023-09-15T16:34:03.949 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:34:19.014 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:34:19.016 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:34:34.088 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:34:34.089 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:34:49.162 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:34:49.164 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:35:04.242 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:35:04.243 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:35:19.318 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:35:19.319 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:35:34.398 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:35:34.399 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:35:49.470 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:35:49.471 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:36:04.554 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:36:04.556 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:36:19.642 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:36:19.644 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:36:34.726 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:36:34.727 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:36:49.818 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-15T16:36:49.819 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-15T16:36:49.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:36:49.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:08.378 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-15T16:37:08.379 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-15T16:37:14.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:14.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:17.434 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-15T16:37:17.434 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-15T16:37:23.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:23.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:26.522 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-15T16:37:26.523 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-15T16:37:32.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:32.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:35.610 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-15T16:37:35.610 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-15T16:37:41.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:41.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:44.702 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-15T16:37:44.703 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-15T16:37:50.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:37:50.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:38:22.342 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-15T16:38:22.343 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-15T16:38:22.344 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-15T16:38:22.344 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-15T16:38:47.452 INFO:teuthology.provision.fog.smithi096:Node is ready 2023-09-15T16:38:47.453 DEBUG:teuthology.orchestra.run.smithi096:> hostname 2023-09-15T16:38:47.477 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2023-09-15T16:38:47.478 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts 2023-09-15T16:38:47.539 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2023-09-15T16:38:47.539 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-09-15T16:38:47.648 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts 2023-09-15T16:38:47.678 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2023-09-15T16:38:47.746 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname 2023-09-15T16:38:47.815 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-09-15T16:38:47.883 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-09-15T16:38:47.941 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-09-15T16:38:47.941 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2023-09-15T16:38:47.941 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-09-15T16:38:47.941 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-09-15T16:38:47.942 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2023-09-15T16:38:47.942 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-09-15T16:38:47.942 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-15T16:38:47.942 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-09-15T16:38:47.942 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-15T16:38:47.943 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-09-15T16:38:47.943 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-15T16:38:47.943 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-15T16:38:47.943 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-15T16:38:47.944 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2023-09-15T16:38:47.945 DEBUG:teuthology.parallel:result is None 2023-09-15T16:38:48.471 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-09-15T16:38:48.472 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-09-15T16:38:48.496 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-09-15T16:38:48.496 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-09-15T16:38:48.556 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-09-15T16:38:48.557 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-09-15T16:38:48.687 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-09-15T16:38:48.718 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-09-15T16:38:48.788 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-09-15T16:38:48.857 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-09-15T16:38:48.924 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-09-15T16:38:48.982 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-09-15T16:38:48.982 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2023-09-15T16:38:48.983 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-09-15T16:38:48.983 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-09-15T16:38:48.983 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2023-09-15T16:38:48.983 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-09-15T16:38:48.983 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-15T16:38:48.984 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-09-15T16:38:48.984 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-15T16:38:48.984 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-09-15T16:38:48.984 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-15T16:38:48.984 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-15T16:38:48.984 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-15T16:38:48.985 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-09-15T16:38:48.985 DEBUG:teuthology.parallel:result is None 2023-09-15T16:38:49.133 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2023-09-15T16:38:49.133 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-15T16:38:49.156 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-09-15T16:38:49.157 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-15T16:38:49.182 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2023-09-15T16:38:49.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-15T16:38:49.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:38:49.252 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-09-15T16:38:49.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-15T16:38:49.282 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-09-15T16:38:49.341 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-09-15T16:38:49.341 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-09-15T16:38:49.400 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-09-15T16:38:49.400 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2023-09-15T16:38:49.400 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-09-15T16:38:49.401 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-09-15T16:38:49.401 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2023-09-15T16:38:49.401 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-09-15T16:38:49.401 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-15T16:38:49.401 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-09-15T16:38:49.402 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-15T16:38:49.402 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-09-15T16:38:49.402 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-15T16:38:49.402 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-15T16:38:49.403 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-15T16:38:49.403 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-09-15T16:38:49.423 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-09-15T16:38:49.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-09-15T16:38:49.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T16:38:49.489 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-09-15T16:38:49.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-09-15T16:38:49.557 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-09-15T16:38:49.615 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-09-15T16:38:49.615 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-09-15T16:38:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-09-15T16:38:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2023-09-15T16:38:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-09-15T16:38:49.673 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-09-15T16:38:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2023-09-15T16:38:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-09-15T16:38:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-15T16:38:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-09-15T16:38:49.674 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-15T16:38:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-09-15T16:38:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-15T16:38:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-15T16:38:49.675 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-15T16:38:49.676 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-09-15T16:38:49.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:38:49.786 INFO:teuthology.dispatcher.supervisor:Running job 7397177 2023-09-15T16:38:49.786 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397177 --name cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397177/orig.config.yaml 2023-09-15T16:38:49.790 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397177 2023-09-15T16:38:49.790 INFO:teuthology.dispatcher.supervisor:Job PID: 3227290 2023-09-15T16:38:49.791 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-15T16:40:49.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:42:50.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:44:50.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:46:50.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:48:50.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:50:50.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:52:50.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:54:51.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T16:54:51.182 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-15T16:54:51.332 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-15T16:54:51.332 INFO:teuthology.nuke:Checking targets against current locks 2023-09-15T16:54:51.383 DEBUG:teuthology.nuke:shortname: smithi096 2023-09-15T16:54:51.384 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-15T16:54:51.407 DEBUG:teuthology.nuke:shortname: smithi143 2023-09-15T16:54:51.408 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-15T16:54:51.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397177', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 16:33:53.742757', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDkGomqdEuNVM4rrsidJSA1b4eiXRoDkNT+5shAltyKCIzO9Wc+8VynhoS9TyCJBt4Z2EselHSK1eVh3iFkl+gM='} 2023-09-15T16:54:51.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-15_15:32:39-rgw-wip-62507-quincy-distro-default-smithi/7397177', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 16:33:53.744200', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOb838y7Ibccv2LTvTSyUz26qzeY+7cbY6K6ocr8IvBWWnTKQMSjCSwCu7UWQH4S5rm6YY7FMfJXo3YZh6ZPTY='} 2023-09-15T16:54:51.456 INFO:teuthology.orchestra.console.smithi096:Power off 2023-09-15T16:54:51.457 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T16:54:51.478 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-09-15T16:54:51.479 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:54:51.493 INFO:teuthology.orchestra.console.smithi143:Power off 2023-09-15T16:54:51.494 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T16:54:51.503 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-15T16:54:51.515 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-09-15T16:54:51.516 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T16:54:51.539 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-15T16:54:51.604 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-09-15T16:54:51.641 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-09-15T16:54:51.756 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com 2023-09-15T16:54:51.788 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com