2023-08-27T09:56:33.207 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-27T09:56:33.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:56:33.352 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd9e78f71f0>, signals=[15]) 2023-08-27T09:56:33.354 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-08-27T09:56:33.355 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T09:56:33.356 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-08-27T09:56:33.381 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-08-27T09:56:33.382 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T09:56:33.382 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-08-27T09:56:33.384 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"} 2023-08-27T09:56:33.406 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-08-27T09:56:33.461 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-27T09:56:33.473 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-27T09:56:33.502 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10) 2023-08-27T09:56:33.502 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 10} 2023-08-27T09:56:33.515 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_9.stream (ID 10) 2023-08-27T09:56:33.516 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 10} 2023-08-27T09:56:33.548 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream 2023-08-27T09:56:33.549 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:56:33.560 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 9.stream 2023-08-27T09:56:33.560 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:56:33.598 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T09:56:33.599 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T09:56:33.632 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1} 2023-08-27T09:56:33.636 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-08-27T09:56:33.688 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:56:33.689 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:56:33.778 INFO:teuthology.orchestra.console.smithi040:Power off 2023-08-27T09:56:33.779 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T09:56:33.791 INFO:teuthology.orchestra.console.smithi133:Power off 2023-08-27T09:56:33.792 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T09:56:33.799 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-08-27T09:56:33.800 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:33.810 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-08-27T09:56:33.811 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:33.820 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-08-27T09:56:33.832 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-27T09:56:33.922 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-08-27T09:56:33.933 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-08-27T09:56:34.023 INFO:teuthology.orchestra.console.smithi040:Power on 2023-08-27T09:56:34.023 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T09:56:34.035 INFO:teuthology.orchestra.console.smithi133:Power on 2023-08-27T09:56:34.035 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T09:56:34.043 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2023-08-27T09:56:34.044 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:34.055 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-08-27T09:56:34.056 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:34.063 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-08-27T09:56:34.075 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-27T09:56:38.066 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:38.075 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:38.175 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-08-27T09:56:38.183 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-27T09:56:42.177 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:42.184 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:42.285 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-08-27T09:56:42.294 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-08-27T09:56:42.387 INFO:teuthology.orchestra.console.smithi040:Power on completed 2023-08-27T09:56:42.395 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-08-27T09:56:42.488 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-08-27T09:56:42.489 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:56:42.496 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-08-27T09:56:42.496 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:56:57.565 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:56:57.567 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:57:12.634 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:57:12.635 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:57:27.705 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:57:27.706 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:57:42.777 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:57:42.778 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:57:57.853 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:57:57.854 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:58:12.928 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:58:12.930 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:58:27.997 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:58:27.998 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:58:43.070 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:58:43.071 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:58:58.137 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:58:58.138 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:59:13.209 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-08-27T09:59:13.211 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-27T09:59:13.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:13.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:31.589 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-08-27T09:59:31.590 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-27T09:59:37.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:37.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:40.649 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-08-27T09:59:40.650 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-27T09:59:46.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:46.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:49.733 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-08-27T09:59:49.734 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-27T09:59:55.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:55.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:58.789 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-08-27T09:59:58.789 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-27T10:00:04.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:00:04.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:00:07.849 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-27T10:00:13.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:00:32.265 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-27T10:00:38.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:00:41.353 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-27T10:00:47.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:00:48.040 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T10:00:48.040 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T10:01:04.796 WARNING:teuthology.provision.fog.smithi040:timed out 2023-08-27T10:01:10.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:01:11.050 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T10:01:11.050 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T10:01:11.351 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-08-27T10:01:11.351 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-08-27T10:01:11.367 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-08-27T10:01:11.367 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-08-27T10:01:11.422 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-08-27T10:01:11.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-08-27T10:01:11.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-08-27T10:01:11.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-08-27T10:01:11.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-08-27T10:01:11.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-08-27T10:01:11.774 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-08-27T10:01:11.829 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-08-27T10:01:11.830 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-08-27T10:01:11.830 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-08-27T10:01:11.830 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-08-27T10:01:11.830 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-08-27T10:01:11.830 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-08-27T10:01:11.831 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-27T10:01:11.831 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-08-27T10:01:11.831 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-08-27T10:01:11.831 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-27T10:01:11.832 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-08-27T10:01:11.832 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T10:01:11.832 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-27T10:01:11.832 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-27T10:01:11.833 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-08-27T10:01:11.834 DEBUG:teuthology.parallel:result is None 2023-08-27T10:01:13.045 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-08-27T10:01:13.046 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-08-27T10:01:13.064 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2023-08-27T10:01:13.065 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2023-08-27T10:01:13.122 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2023-08-27T10:01:13.122 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-08-27T10:01:13.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2023-08-27T10:01:13.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2023-08-27T10:01:13.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2023-08-27T10:01:13.416 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-08-27T10:01:13.484 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-08-27T10:01:13.539 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-08-27T10:01:13.539 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2023-08-27T10:01:13.540 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-08-27T10:01:13.540 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-08-27T10:01:13.540 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2023-08-27T10:01:13.540 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2023-08-27T10:01:13.540 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-27T10:01:13.541 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-08-27T10:01:13.541 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2023-08-27T10:01:13.541 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-27T10:01:13.541 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-08-27T10:01:13.541 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T10:01:13.542 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-27T10:01:13.542 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-27T10:01:13.542 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-08-27T10:01:13.543 DEBUG:teuthology.parallel:result is None 2023-08-27T10:01:13.717 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-08-27T10:01:13.718 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-27T10:01:13.741 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-08-27T10:01:13.741 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-27T10:01:13.758 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-08-27T10:01:13.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-08-27T10:01:13.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:01:13.858 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-08-27T10:01:13.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-08-27T10:01:13.930 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-08-27T10:01:13.986 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-08-27T10:01:13.988 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-08-27T10:01:14.042 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-08-27T10:01:14.043 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-08-27T10:01:14.043 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-08-27T10:01:14.043 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-08-27T10:01:14.043 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-08-27T10:01:14.044 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-08-27T10:01:14.044 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-27T10:01:14.044 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-08-27T10:01:14.044 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-08-27T10:01:14.044 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-27T10:01:14.045 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-08-27T10:01:14.045 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T10:01:14.045 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-27T10:01:14.045 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-27T10:01:14.046 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-08-27T10:01:14.066 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-08-27T10:01:14.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-08-27T10:01:14.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:01:14.150 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-08-27T10:01:14.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-08-27T10:01:14.215 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-08-27T10:01:14.269 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-08-27T10:01:14.270 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-08-27T10:01:14.323 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-08-27T10:01:14.323 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2023-08-27T10:01:14.323 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-08-27T10:01:14.324 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-08-27T10:01:14.324 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2023-08-27T10:01:14.324 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2023-08-27T10:01:14.324 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-27T10:01:14.324 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-08-27T10:01:14.325 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2023-08-27T10:01:14.325 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-27T10:01:14.325 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-08-27T10:01:14.325 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T10:01:14.325 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-27T10:01:14.326 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-27T10:01:14.326 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-08-27T10:01:14.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:01:14.429 INFO:teuthology.dispatcher.supervisor:Running job 7382025 2023-08-27T10:01:14.429 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382025 --name matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} -- /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382025/orig.config.yaml 2023-08-27T10:01:14.433 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382025 2023-08-27T10:01:14.434 INFO:teuthology.dispatcher.supervisor:Job PID: 1211041 2023-08-27T10:01:14.434 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-27T10:03:14.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:03:14.603 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-27T10:03:14.703 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-27T10:03:14.704 INFO:teuthology.nuke:Checking targets against current locks 2023-08-27T10:03:14.750 DEBUG:teuthology.nuke:shortname: smithi040 2023-08-27T10:03:14.750 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T10:03:14.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382025', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 09:56:31.866566', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIk1a9p5S62WK7quIxhoMlvyhg1sX/vaaTrGRPp0VKJIXnNqNcOhR/o/OtdReioWUAmdhO4XKI7f38MFf7+/KmE='} 2023-08-27T10:03:14.772 DEBUG:teuthology.nuke:shortname: smithi133 2023-08-27T10:03:14.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T10:03:14.790 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382025', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 09:56:31.868196', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFBQdcRN5cNQ9wfCSvty25G8B2BW5NmWlMPjwSkjAFwF5e0HNNuHxHmyHcu2VrU5r6okHajIZi8KsHeFWLeJBmo='} 2023-08-27T10:03:14.818 INFO:teuthology.orchestra.console.smithi040:Power off 2023-08-27T10:03:14.819 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T10:03:14.838 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-08-27T10:03:14.838 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T10:03:14.849 INFO:teuthology.orchestra.console.smithi133:Power off 2023-08-27T10:03:14.849 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T10:03:14.858 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-08-27T10:03:14.868 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-08-27T10:03:14.869 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T10:03:14.887 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-27T10:03:14.959 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-08-27T10:03:14.989 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-08-27T10:03:15.110 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-08-27T10:03:15.135 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com