2023-11-14T17:18:42.477 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-14T17:18:42.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:18:42.614 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7629336670>, signals=[15]) 2023-11-14T17:18:42.616 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-11-14T17:18:42.617 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T17:18:42.617 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-11-14T17:18:42.644 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-11-14T17:18:42.644 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T17:18:42.645 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-11-14T17:18:42.646 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"} 2023-11-14T17:18:42.669 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"} 2023-11-14T17:18:42.733 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-14T17:18:42.737 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-14T17:18:42.779 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_8.stream (ID 3) 2023-11-14T17:18:42.779 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 3} 2023-11-14T17:18:42.785 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_8.stream (ID 3) 2023-11-14T17:18:42.785 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 3} 2023-11-14T17:18:42.832 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 8.stream 2023-11-14T17:18:42.832 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:18:42.836 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 8.stream 2023-11-14T17:18:42.837 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:18:42.891 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T17:18:42.893 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T17:18:42.936 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1} 2023-11-14T17:18:42.943 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1} 2023-11-14T17:18:42.991 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:18:43.039 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:18:43.090 INFO:teuthology.orchestra.console.smithi092:Power off 2023-11-14T17:18:43.091 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T17:18:43.117 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-11-14T17:18:43.117 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:43.130 INFO:teuthology.orchestra.console.smithi006:Power off 2023-11-14T17:18:43.131 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T17:18:43.144 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-11-14T17:18:43.157 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-11-14T17:18:43.158 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:43.181 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-14T17:18:47.149 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:47.182 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:47.258 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-11-14T17:18:47.293 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-14T17:18:51.262 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:51.294 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:51.374 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-11-14T17:18:51.403 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-11-14T17:18:51.504 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-11-14T17:18:51.605 INFO:teuthology.orchestra.console.smithi006:Power on 2023-11-14T17:18:51.605 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T17:18:51.651 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2023-11-14T17:18:51.652 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:51.687 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-11-14T17:18:55.378 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:55.492 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-11-14T17:18:55.593 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-11-14T17:18:55.689 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:55.697 INFO:teuthology.orchestra.console.smithi092:Power on 2023-11-14T17:18:55.698 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T17:18:55.721 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2023-11-14T17:18:55.721 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:55.746 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-11-14T17:18:55.800 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-11-14T17:18:59.750 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:59.802 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:18:59.860 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-11-14T17:18:59.914 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-14T17:19:00.015 INFO:teuthology.orchestra.console.smithi006:Power on completed 2023-11-14T17:19:00.116 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-11-14T17:19:00.116 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:19:03.864 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T17:19:03.973 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-11-14T17:19:04.074 INFO:teuthology.orchestra.console.smithi092:Power on completed 2023-11-14T17:19:04.175 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-11-14T17:19:04.176 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:19:15.190 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:19:19.254 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:19:30.270 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:19:34.325 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:19:45.346 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:19:49.394 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:20:00.410 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:20:04.460 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:20:15.482 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:20:19.531 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:20:30.550 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:20:34.600 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:20:45.618 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:20:49.676 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:21:00.686 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:21:04.747 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:21:15.756 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:21:19.818 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:21:30.834 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-11-14T17:21:30.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:21:33.950 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-14T17:21:34.879 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:21:39.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:21:43.038 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-14T17:21:49.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:21:49.935 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-11-14T17:21:49.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:21:52.126 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-14T17:21:53.050 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-14T17:21:58.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:21:59.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:22:01.210 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-14T17:22:02.106 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-14T17:22:07.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:22:08.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:22:10.266 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-14T17:22:11.162 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-14T17:22:16.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:22:17.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:22:20.218 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-14T17:22:26.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:22:29.278 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-14T17:22:35.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:22:38.362 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-11-14T17:22:44.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:23:16.302 WARNING:teuthology.provision.fog.smithi006:timed out 2023-11-14T17:23:22.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:23:22.536 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T17:23:22.537 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T17:23:22.918 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-11-14T17:23:22.919 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-11-14T17:23:22.940 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-11-14T17:23:22.940 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-11-14T17:23:23.001 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-11-14T17:23:23.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-11-14T17:23:23.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-11-14T17:23:23.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-11-14T17:23:23.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-11-14T17:23:23.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-11-14T17:23:23.346 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-11-14T17:23:23.405 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-11-14T17:23:23.406 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2023-11-14T17:23:23.406 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-11-14T17:23:23.406 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-11-14T17:23:23.406 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2023-11-14T17:23:23.407 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-11-14T17:23:23.407 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-14T17:23:23.407 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-11-14T17:23:23.407 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-14T17:23:23.407 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-11-14T17:23:23.408 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-14T17:23:23.408 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-14T17:23:23.408 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-14T17:23:23.409 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-11-14T17:23:23.410 DEBUG:teuthology.parallel:result is None 2023-11-14T17:23:44.391 WARNING:teuthology.provision.fog.smithi092:timed out 2023-11-14T17:23:50.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:23:50.630 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T17:23:50.631 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T17:23:50.868 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-11-14T17:23:50.869 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-11-14T17:23:50.890 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2023-11-14T17:23:50.891 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2023-11-14T17:23:50.952 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-11-14T17:23:50.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-11-14T17:23:51.053 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2023-11-14T17:23:51.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-11-14T17:23:51.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2023-11-14T17:23:51.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-11-14T17:23:51.307 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-11-14T17:23:51.369 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2023-11-14T17:23:51.369 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8" 2023-11-14T17:23:51.370 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2023-11-14T17:23:51.370 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2023-11-14T17:23:51.370 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8" 2023-11-14T17:23:51.370 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-11-14T17:23:51.370 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-14T17:23:51.371 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-11-14T17:23:51.371 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-14T17:23:51.371 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2023-11-14T17:23:51.371 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-14T17:23:51.371 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-14T17:23:51.372 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-14T17:23:51.372 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-11-14T17:23:51.373 DEBUG:teuthology.parallel:result is None 2023-11-14T17:23:51.531 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-11-14T17:23:51.532 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T17:23:51.560 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-11-14T17:23:51.560 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T17:23:51.585 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-11-14T17:23:51.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-14T17:23:51.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:23:51.656 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-11-14T17:23:51.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-14T17:23:51.751 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-11-14T17:23:51.811 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-11-14T17:23:51.812 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-11-14T17:23:51.871 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-11-14T17:23:51.872 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2023-11-14T17:23:51.872 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-11-14T17:23:51.872 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-11-14T17:23:51.872 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2023-11-14T17:23:51.872 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-11-14T17:23:51.873 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-14T17:23:51.873 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-11-14T17:23:51.873 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-14T17:23:51.873 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-11-14T17:23:51.873 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-14T17:23:51.874 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-14T17:23:51.874 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-14T17:23:51.874 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-11-14T17:23:51.902 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-11-14T17:23:51.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-11-14T17:23:51.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T17:23:51.971 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-11-14T17:23:52.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-11-14T17:23:52.044 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-11-14T17:23:52.105 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-11-14T17:23:52.105 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-11-14T17:23:52.167 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2023-11-14T17:23:52.168 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8" 2023-11-14T17:23:52.169 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2023-11-14T17:23:52.169 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2023-11-14T17:23:52.169 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8" 2023-11-14T17:23:52.169 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-11-14T17:23:52.170 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-14T17:23:52.170 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-11-14T17:23:52.170 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-14T17:23:52.170 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2023-11-14T17:23:52.171 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-14T17:23:52.171 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-14T17:23:52.171 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-14T17:23:52.172 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-11-14T17:23:52.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:23:52.280 INFO:teuthology.dispatcher.supervisor:Running job 7457475 2023-11-14T17:23:52.281 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-14_15:38:06-rgw-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457475 --name yuriw-2023-11-14_15:38:06-rgw-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zones supported-random-distro$/{centos_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2023-11-14_15:38:06-rgw-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457475/orig.config.yaml 2023-11-14T17:23:52.284 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-14_15:38:06-rgw-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457475 2023-11-14T17:23:52.284 INFO:teuthology.dispatcher.supervisor:Job PID: 3063299 2023-11-14T17:23:52.285 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-14T17:25:52.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:27:52.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:29:52.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:31:52.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:33:53.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:35:53.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:37:53.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:39:53.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:41:53.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:43:53.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:45:54.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:47:54.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:49:54.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:51:54.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:53:54.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:55:54.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:57:55.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T17:59:55.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:01:55.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:03:55.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:05:55.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:07:55.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:09:56.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:11:56.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:13:56.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:15:56.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:17:56.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:19:56.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:21:57.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:23:57.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:25:57.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:27:57.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T18:27:57.611 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-14T18:27:57.712 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-14T18:27:57.712 INFO:teuthology.nuke:Checking targets against current locks 2023-11-14T18:27:57.758 DEBUG:teuthology.nuke:shortname: smithi006 2023-11-14T18:27:57.759 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-14T18:27:57.779 DEBUG:teuthology.nuke:shortname: smithi092 2023-11-14T18:27:57.779 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-14T18:27:57.783 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_15:38:06-rgw-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457475', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 17:18:41.639132', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJHpzqpF395m+hHo3oBttJoyiqJVHW/1N9WLiPfsgG052e7F0xryavz1ZET5wmcSKs9uyR39nZyLFkDjFFpg84s='} 2023-11-14T18:27:57.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_15:38:06-rgw-wip-yuri2-testing-2023-11-13-0820-pacific-distro-default-smithi/7457475', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 17:18:41.640279', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDmnCwJzwyffEONwjFyvLbhjB6GdJj3hwXUPwg4sR0/9ijCdPoBUC41pF7YCk/NiJxCllEsKnXQ9zIcEMP2yGqc='} 2023-11-14T18:27:57.834 INFO:teuthology.orchestra.console.smithi006:Power off 2023-11-14T18:27:57.835 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T18:27:57.856 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-11-14T18:27:57.856 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T18:27:57.871 INFO:teuthology.orchestra.console.smithi092:Power off 2023-11-14T18:27:57.871 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T18:27:57.880 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-11-14T18:27:57.891 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-11-14T18:27:57.892 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T18:27:57.914 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-11-14T18:27:57.982 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-11-14T18:27:58.015 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-11-14T18:27:58.136 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2023-11-14T18:27:58.169 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com