2023-09-29T23:29:36.374 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-29T23:29:36.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:29:36.504 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f067c37e670>, signals=[15]) 2023-09-29T23:29:36.505 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-09-29T23:29:36.505 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-09-29T23:29:36.506 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-09-29T23:29:36.527 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-09-29T23:29:36.528 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-09-29T23:29:36.528 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-09-29T23:29:36.530 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-09-29T23:29:36.552 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-09-29T23:29:36.604 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-29T23:29:36.621 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-29T23:29:36.645 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_8.stream (ID 3) 2023-09-29T23:29:36.645 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 3} 2023-09-29T23:29:36.662 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_8.stream (ID 3) 2023-09-29T23:29:36.662 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 3} 2023-09-29T23:29:36.689 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 8.stream 2023-09-29T23:29:36.689 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:29:36.710 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 8.stream 2023-09-29T23:29:36.710 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:29:36.750 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-09-29T23:29:36.759 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-09-29T23:29:36.800 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-09-29T23:29:36.805 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-09-29T23:29:36.854 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:29:36.861 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:29:36.956 INFO:teuthology.orchestra.console.smithi151:Power off 2023-09-29T23:29:36.956 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T23:29:36.970 INFO:teuthology.orchestra.console.smithi172:Power off 2023-09-29T23:29:36.970 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T23:29:36.977 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-09-29T23:29:36.978 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:29:36.992 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-09-29T23:29:36.992 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:29:36.999 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-09-29T23:29:37.012 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-09-29T23:29:37.101 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-09-29T23:29:37.113 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-09-29T23:29:37.201 INFO:teuthology.orchestra.console.smithi151:Power on 2023-09-29T23:29:37.202 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-29T23:29:37.214 INFO:teuthology.orchestra.console.smithi172:Power on 2023-09-29T23:29:37.215 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-29T23:29:37.221 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2023-09-29T23:29:37.222 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:29:37.234 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-09-29T23:29:37.234 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:29:37.242 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-09-29T23:29:37.253 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-09-29T23:29:41.247 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:29:41.254 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:29:41.356 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-09-29T23:29:41.361 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-09-29T23:29:41.462 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-09-29T23:29:41.562 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-09-29T23:29:41.563 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:29:45.361 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:29:45.564 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-09-29T23:29:45.665 INFO:teuthology.orchestra.console.smithi151:Power on completed 2023-09-29T23:29:45.766 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-09-29T23:29:45.766 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:29:56.660 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:30:00.838 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:30:11.748 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:30:15.902 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:30:26.838 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:30:30.970 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:30:41.933 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:30:46.050 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:30:57.026 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:31:01.125 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:31:12.104 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:31:16.190 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:31:27.198 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:31:31.253 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:31:42.276 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:31:46.330 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:31:57.358 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:32:01.418 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:32:12.426 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:32:16.480 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:32:27.494 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-09-29T23:32:27.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:32:31.545 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-09-29T23:32:31.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:32:46.074 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-29T23:32:50.170 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-09-29T23:32:52.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:32:55.130 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-29T23:32:56.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:32:59.226 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-09-29T23:33:01.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:04.186 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-29T23:33:05.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:08.286 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-09-29T23:33:10.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:13.242 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-29T23:33:14.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:17.370 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-09-29T23:33:19.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:22.298 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-29T23:33:23.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:26.426 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-09-29T23:33:28.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:31.359 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-09-29T23:33:32.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:37.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:50.846 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-09-29T23:33:56.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:33:59.930 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-09-29T23:34:05.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:34:08.391 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-29T23:34:08.391 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-29T23:34:33.449 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-09-29T23:34:33.450 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-09-29T23:34:33.474 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-09-29T23:34:33.474 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2023-09-29T23:34:33.534 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-09-29T23:34:33.535 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-09-29T23:34:33.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2023-09-29T23:34:33.686 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-09-29T23:34:33.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2023-09-29T23:34:33.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-09-29T23:34:33.895 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-09-29T23:34:33.954 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-09-29T23:34:33.955 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T23:34:33.956 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T23:34:33.956 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-29T23:34:33.956 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-09-29T23:34:33.957 DEBUG:teuthology.parallel:result is None 2023-09-29T23:34:37.367 WARNING:teuthology.provision.fog.smithi172:timed out 2023-09-29T23:34:43.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:34:43.635 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-29T23:34:43.636 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-29T23:34:43.913 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-09-29T23:34:43.913 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-09-29T23:34:43.932 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2023-09-29T23:34:43.932 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2023-09-29T23:34:43.992 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-09-29T23:34:43.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-09-29T23:34:44.096 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2023-09-29T23:34:44.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-09-29T23:34:44.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2023-09-29T23:34:44.263 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-09-29T23:34:44.331 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-09-29T23:34:44.389 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-09-29T23:34:44.389 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8" 2023-09-29T23:34:44.389 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-09-29T23:34:44.389 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T23:34:44.390 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-29T23:34:44.391 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-09-29T23:34:44.391 DEBUG:teuthology.parallel:result is None 2023-09-29T23:34:44.538 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-09-29T23:34:44.539 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-29T23:34:44.560 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-09-29T23:34:44.560 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-29T23:34:44.577 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-09-29T23:34:44.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-09-29T23:34:44.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:34:44.644 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-09-29T23:34:44.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-09-29T23:34:44.781 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-09-29T23:34:44.840 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-09-29T23:34:44.840 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-29T23:34:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-09-29T23:34:44.900 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T23:34:44.900 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T23:34:44.900 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-29T23:34:44.900 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-09-29T23:34:44.919 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-09-29T23:34:44.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-09-29T23:34:44.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:34:44.986 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-09-29T23:34:45.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-09-29T23:34:45.056 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-09-29T23:34:45.114 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-09-29T23:34:45.115 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-09-29T23:34:45.173 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-09-29T23:34:45.173 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8" 2023-09-29T23:34:45.173 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-09-29T23:34:45.173 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-09-29T23:34:45.173 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8" 2023-09-29T23:34:45.173 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-09-29T23:34:45.174 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-29T23:34:45.174 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-09-29T23:34:45.174 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-29T23:34:45.174 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-09-29T23:34:45.174 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T23:34:45.174 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T23:34:45.174 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-29T23:34:45.175 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-09-29T23:34:45.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:34:45.307 INFO:teuthology.dispatcher.supervisor:Running job 7406627 2023-09-29T23:34:45.307 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406627 --name yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406627/orig.config.yaml 2023-09-29T23:34:45.310 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406627 2023-09-29T23:34:45.310 INFO:teuthology.dispatcher.supervisor:Job PID: 2337814 2023-09-29T23:34:45.311 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-29T23:36:45.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:38:45.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:40:45.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:42:45.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:44:46.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:46:46.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:48:46.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:50:46.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:52:46.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:54:46.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:56:47.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:58:47.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:00:47.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:02:47.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:04:47.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:06:47.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:08:48.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:10:48.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:12:48.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:14:48.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:16:48.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:18:48.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:20:48.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:22:49.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:24:49.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:26:49.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:28:49.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:30:49.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:32:50.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:34:50.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:36:50.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:38:50.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:40:50.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:42:50.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:44:51.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:44:51.133 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-30T00:44:51.238 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-30T00:44:51.239 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T00:44:51.287 DEBUG:teuthology.nuke:shortname: smithi151 2023-09-30T00:44:51.287 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T00:44:51.311 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406627', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 23:29:35.611906', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhhvASaNFrCzxA+9VSdw4BtxuIWtbsAYDt7y++4T8wTJ4nys+n5V/9MmLSoI7ackzD4DlL3Nv68h5h9KMz1CL4='} 2023-09-30T00:44:51.314 DEBUG:teuthology.nuke:shortname: smithi172 2023-09-30T00:44:51.315 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T00:44:51.338 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406627', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 23:29:35.610345', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKz4fF1ogMOz6LCNUZabiNqgUXoJLiq2vxF+7pj35Z4MF6Yf0qRa9ccPpbv4kHYOP0ZkPMTgXh8oa/9IDZ1NRJo='} 2023-09-30T00:44:51.367 INFO:teuthology.orchestra.console.smithi151:Power off 2023-09-30T00:44:51.368 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T00:44:51.387 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-09-30T00:44:51.388 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T00:44:51.400 INFO:teuthology.orchestra.console.smithi172:Power off 2023-09-30T00:44:51.401 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T00:44:51.409 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-09-30T00:44:51.423 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-09-30T00:44:51.423 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T00:44:51.446 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-09-30T00:44:51.509 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-09-30T00:44:51.547 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-09-30T00:44:51.667 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com 2023-09-30T00:44:51.691 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com