2023-08-17T23:57:15.530 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-17T23:57:15.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T23:57:15.678 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe1837eaee0>, signals=[15]) 2023-08-17T23:57:15.679 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-08-17T23:57:15.680 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-08-17T23:57:15.680 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-08-17T23:57:15.705 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-08-17T23:57:15.705 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-08-17T23:57:15.706 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-08-17T23:57:15.707 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-08-17T23:57:15.730 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"} 2023-08-17T23:57:15.771 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-17T23:57:15.794 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-17T23:57:15.803 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10) 2023-08-17T23:57:15.803 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 10} 2023-08-17T23:57:15.833 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_9.stream (ID 10) 2023-08-17T23:57:15.834 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 10} 2023-08-17T23:57:15.863 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream 2023-08-17T23:57:15.863 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:57:15.879 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 9.stream 2023-08-17T23:57:15.880 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:57:15.933 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-08-17T23:57:15.940 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"} 2023-08-17T23:57:15.964 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-08-17T23:57:15.977 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1} 2023-08-17T23:57:16.016 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:57:16.030 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:57:16.132 INFO:teuthology.orchestra.console.smithi111:Power off 2023-08-17T23:57:16.133 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T23:57:16.148 INFO:teuthology.orchestra.console.smithi134:Power off 2023-08-17T23:57:16.149 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T23:57:16.158 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-08-17T23:57:16.158 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:16.172 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-08-17T23:57:16.173 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:16.183 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-17T23:57:16.194 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-17T23:57:20.188 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:20.198 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:20.301 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-17T23:57:20.311 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-17T23:57:24.306 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:24.314 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:24.417 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-17T23:57:24.424 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-17T23:57:28.420 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:28.430 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:28.532 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-17T23:57:28.542 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-17T23:57:28.634 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-08-17T23:57:28.644 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-08-17T23:57:28.735 INFO:teuthology.orchestra.console.smithi111:Power on 2023-08-17T23:57:28.735 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-17T23:57:28.746 INFO:teuthology.orchestra.console.smithi134:Power on 2023-08-17T23:57:28.747 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-17T23:57:28.759 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2023-08-17T23:57:28.760 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:28.771 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2023-08-17T23:57:28.771 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:28.781 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-17T23:57:28.791 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-17T23:57:32.784 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:32.793 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:32.895 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-17T23:57:32.905 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-17T23:57:32.996 INFO:teuthology.orchestra.console.smithi111:Power on completed 2023-08-17T23:57:33.097 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-08-17T23:57:33.098 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:57:36.908 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T23:57:37.018 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-08-17T23:57:37.119 INFO:teuthology.orchestra.console.smithi134:Power on completed 2023-08-17T23:57:37.220 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-08-17T23:57:37.220 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:57:48.196 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:57:52.300 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:58:03.280 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:58:07.372 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:58:18.356 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:58:22.450 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:58:33.428 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:58:37.520 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:58:48.512 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:58:52.600 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:59:03.604 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:59:07.680 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:59:18.684 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:59:22.756 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:59:33.768 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:59:37.836 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-17T23:59:48.844 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-17T23:59:52.908 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-18T00:00:03.916 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-18T00:00:07.984 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-08-18T00:00:08.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:11.124 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-18T00:00:17.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:18.998 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-18T00:00:20.208 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-18T00:00:26.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:29.264 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-18T00:00:34.073 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-18T00:00:34.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:35.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:37.201 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-18T00:00:38.356 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-18T00:00:43.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:44.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:46.292 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-18T00:00:47.408 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-18T00:00:52.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:53.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:00:55.376 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-18T00:00:56.464 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-08-18T00:01:01.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:01:02.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:01:04.432 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-18T00:01:10.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:01:13.492 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-18T00:01:19.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:01:22.580 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-18T00:01:28.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:01:31.668 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-18T00:01:37.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:01:40.752 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-18T00:01:46.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:02:02.485 WARNING:teuthology.provision.fog.smithi134:timed out 2023-08-18T00:02:08.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:02:08.771 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-18T00:02:08.773 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-18T00:02:09.067 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-08-18T00:02:09.068 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-08-18T00:02:09.083 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2023-08-18T00:02:09.083 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2023-08-18T00:02:09.138 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-08-18T00:02:09.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-08-18T00:02:09.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2023-08-18T00:02:09.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-08-18T00:02:09.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2023-08-18T00:02:09.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-08-18T00:02:09.500 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-08-18T00:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-08-18T00:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2023-08-18T00:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-08-18T00:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-08-18T00:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2023-08-18T00:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2023-08-18T00:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-18T00:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-08-18T00:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2023-08-18T00:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-18T00:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-08-18T00:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T00:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-18T00:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-18T00:02:09.558 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-08-18T00:02:09.562 DEBUG:teuthology.parallel:result is None 2023-08-18T00:02:46.795 WARNING:teuthology.provision.fog.smithi111:timed out 2023-08-18T00:02:52.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:02:53.048 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-18T00:02:53.048 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-18T00:02:53.424 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-08-18T00:02:53.424 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-08-18T00:02:53.439 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-08-18T00:02:53.440 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-08-18T00:02:53.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-08-18T00:02:53.495 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-08-18T00:02:53.620 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-08-18T00:02:53.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-08-18T00:02:53.718 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-08-18T00:02:53.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-08-18T00:02:53.853 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-08-18T00:02:53.908 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2023-08-18T00:02:53.909 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2023-08-18T00:02:53.909 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2023-08-18T00:02:53.909 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2023-08-18T00:02:53.909 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2023-08-18T00:02:53.909 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2023-08-18T00:02:53.909 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-18T00:02:53.910 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-08-18T00:02:53.910 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2023-08-18T00:02:53.910 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-18T00:02:53.910 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2023-08-18T00:02:53.910 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T00:02:53.910 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-18T00:02:53.911 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-18T00:02:53.911 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-08-18T00:02:53.911 DEBUG:teuthology.parallel:result is None 2023-08-18T00:02:54.055 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-08-18T00:02:54.056 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-18T00:02:54.088 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2023-08-18T00:02:54.089 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-18T00:02:54.106 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-08-18T00:02:54.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-08-18T00:02:54.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:02:54.191 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-08-18T00:02:54.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-08-18T00:02:54.259 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-08-18T00:02:54.314 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-08-18T00:02:54.315 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-08-18T00:02:54.369 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2023-08-18T00:02:54.369 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2023-08-18T00:02:54.369 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2023-08-18T00:02:54.369 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2023-08-18T00:02:54.370 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2023-08-18T00:02:54.370 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2023-08-18T00:02:54.370 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-18T00:02:54.370 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-08-18T00:02:54.370 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2023-08-18T00:02:54.370 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-18T00:02:54.370 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2023-08-18T00:02:54.371 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T00:02:54.371 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-18T00:02:54.371 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-18T00:02:54.371 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-08-18T00:02:54.397 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2023-08-18T00:02:54.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-08-18T00:02:54.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T00:02:54.482 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-08-18T00:02:54.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-08-18T00:02:54.643 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-08-18T00:02:54.696 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-08-18T00:02:54.697 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-08-18T00:02:54.750 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-08-18T00:02:54.751 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2023-08-18T00:02:54.751 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-08-18T00:02:54.751 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-08-18T00:02:54.751 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2023-08-18T00:02:54.751 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2023-08-18T00:02:54.751 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-18T00:02:54.752 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-08-18T00:02:54.752 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2023-08-18T00:02:54.752 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-18T00:02:54.752 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-08-18T00:02:54.752 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-18T00:02:54.752 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-18T00:02:54.752 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-18T00:02:54.753 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-08-18T00:02:54.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:02:54.861 INFO:teuthology.dispatcher.supervisor:Running job 7372301 2023-08-18T00:02:54.862 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-08-17_21:47:04-rgw-pr-52673-distro-default-smithi/7372301 --name cbodley-2023-08-17_21:47:04-rgw-pr-52673-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/cbodley-2023-08-17_21:47:04-rgw-pr-52673-distro-default-smithi/7372301/orig.config.yaml 2023-08-18T00:02:54.865 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-08-17_21:47:04-rgw-pr-52673-distro-default-smithi/7372301 2023-08-18T00:02:54.866 INFO:teuthology.dispatcher.supervisor:Job PID: 10876 2023-08-18T00:02:54.866 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-18T00:04:54.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:06:55.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:08:55.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:10:55.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:12:55.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:14:55.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:16:55.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:18:56.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:20:56.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:22:56.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:24:56.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:26:56.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:28:57.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:30:57.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:32:57.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:34:57.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:36:57.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:38:57.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:40:58.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:42:58.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:44:58.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:46:58.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:48:58.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:50:58.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:52:58.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:54:59.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:56:59.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T00:56:59.267 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-18T00:56:59.431 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-18T00:56:59.431 INFO:teuthology.nuke:Checking targets against current locks 2023-08-18T00:56:59.472 DEBUG:teuthology.nuke:shortname: smithi111 2023-08-18T00:56:59.472 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-18T00:56:59.494 DEBUG:teuthology.nuke:shortname: smithi134 2023-08-18T00:56:59.494 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-18T00:56:59.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-08-17_21:47:04-rgw-pr-52673-distro-default-smithi/7372301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 23:57:14.719456', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCOYXWBA3SLfYzw3Vo4upb893QZdT/Qa3LR4xEx2IQbDyfb8ADawJp5oQfH2p5O4pz2hafuyS/hyQCysoYV9JE0='} 2023-08-18T00:56:59.514 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-08-17_21:47:04-rgw-pr-52673-distro-default-smithi/7372301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 23:57:14.721096', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE4/YzNotg3dKZhF3tr+QPhFI4BJ5j7GteIqeTxw/GZfy7IfUxgJRWBs0sUCjXvgQ11UIuJIBv5jF9+ra499HzY='} 2023-08-18T00:56:59.540 INFO:teuthology.orchestra.console.smithi111:Power off 2023-08-18T00:56:59.541 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T00:56:59.559 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-08-18T00:56:59.560 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T00:56:59.576 INFO:teuthology.orchestra.console.smithi134:Power off 2023-08-18T00:56:59.577 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T00:56:59.587 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-18T00:56:59.597 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-08-18T00:56:59.597 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T00:56:59.617 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-08-18T00:56:59.688 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-08-18T00:56:59.719 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-08-18T00:56:59.833 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2023-08-18T00:56:59.865 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com