2023-08-28T19:18:05.190 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-28T19:18:05.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T19:18:05.327 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd1b2b471f0>, signals=[15]) 2023-08-28T19:18:05.328 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2023-08-28T19:18:05.328 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T19:18:05.328 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-08-28T19:18:05.353 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-08-28T19:18:05.353 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-08-28T19:18:05.354 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-08-28T19:18:05.355 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"} 2023-08-28T19:18:05.378 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-08-28T19:18:05.431 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-28T19:18:05.446 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-28T19:18:05.478 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_centos_9.stream (ID 10) 2023-08-28T19:18:05.478 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 10} 2023-08-28T19:18:05.493 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_9.stream (ID 10) 2023-08-28T19:18:05.493 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 10} 2023-08-28T19:18:05.523 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 9.stream 2023-08-28T19:18:05.523 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:18:05.530 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 9.stream 2023-08-28T19:18:05.530 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:18:05.594 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T19:18:05.595 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"} 2023-08-28T19:18:05.632 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-08-28T19:18:05.641 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1} 2023-08-28T19:18:05.682 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:18:05.767 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:18:05.828 INFO:teuthology.orchestra.console.smithi193:Power off 2023-08-28T19:18:05.829 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T19:18:05.848 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-08-28T19:18:05.848 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:18:05.866 INFO:teuthology.orchestra.console.smithi007:Power off 2023-08-28T19:18:05.866 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T19:18:05.874 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-28T19:18:05.887 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-08-28T19:18:05.888 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:18:05.907 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-08-28T19:18:05.975 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-08-28T19:18:06.008 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-08-28T19:18:06.076 INFO:teuthology.orchestra.console.smithi193:Power on 2023-08-28T19:18:06.076 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T19:18:06.097 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2023-08-28T19:18:06.097 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:18:06.109 INFO:teuthology.orchestra.console.smithi007:Power on 2023-08-28T19:18:06.110 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-28T19:18:06.118 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-28T19:18:06.129 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On 2023-08-28T19:18:06.129 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:18:06.149 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-08-28T19:18:10.119 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:18:10.149 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:18:10.228 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-28T19:18:10.258 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-08-28T19:18:14.231 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:18:14.259 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:18:14.340 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-28T19:18:14.367 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-08-28T19:18:14.442 INFO:teuthology.orchestra.console.smithi193:Power on completed 2023-08-28T19:18:14.468 INFO:teuthology.orchestra.console.smithi007:Power on completed 2023-08-28T19:18:14.543 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-08-28T19:18:14.543 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:18:14.570 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2023-08-28T19:18:14.570 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:18:29.626 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:18:29.640 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:18:44.707 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:18:44.709 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:18:59.783 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:18:59.785 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:19:14.863 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:19:14.865 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:19:29.947 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:19:29.948 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:19:45.023 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:19:45.025 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:20:00.103 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:20:00.105 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:20:15.187 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:20:15.189 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:20:30.263 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:20:30.264 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:20:45.335 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-08-28T19:20:45.336 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-28T19:20:45.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:20:45.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:20:48.444 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-08-28T19:20:48.444 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-28T19:20:54.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:20:54.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:20:57.499 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-08-28T19:20:57.500 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-28T19:21:03.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:21:03.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:21:06.555 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-08-28T19:21:06.587 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-28T19:21:12.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:21:12.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:21:15.643 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-08-28T19:21:15.644 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-28T19:21:21.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:21:21.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:21:24.703 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-08-28T19:21:24.704 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-28T19:21:30.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:21:30.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:21:33.787 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-28T19:21:39.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:22:30.743 WARNING:teuthology.provision.fog.smithi007:timed out 2023-08-28T19:22:36.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:22:36.942 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T19:22:36.943 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T19:22:37.296 INFO:teuthology.provision.fog.smithi007:Node is ready 2023-08-28T19:22:37.297 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2023-08-28T19:22:37.311 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2023-08-28T19:22:37.311 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2023-08-28T19:22:37.366 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2023-08-28T19:22:37.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-08-28T19:22:37.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2023-08-28T19:22:37.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2023-08-28T19:22:37.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2023-08-28T19:22:37.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-08-28T19:22:37.749 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-08-28T19:22:37.804 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2023-08-28T19:22:37.804 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2023-08-28T19:22:37.804 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2023-08-28T19:22:37.804 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2023-08-28T19:22:37.804 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-28T19:22:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T19:22:37.806 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2023-08-28T19:22:37.807 DEBUG:teuthology.parallel:result is None 2023-08-28T19:22:39.795 WARNING:teuthology.provision.fog.smithi193:timed out 2023-08-28T19:22:45.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:22:46.014 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-28T19:22:46.014 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-28T19:22:46.359 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-08-28T19:22:46.359 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-08-28T19:22:46.374 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-08-28T19:22:46.374 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-08-28T19:22:46.429 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-08-28T19:22:46.429 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-08-28T19:22:46.549 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-08-28T19:22:46.577 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-08-28T19:22:46.645 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-08-28T19:22:46.712 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-08-28T19:22:46.779 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-08-28T19:22:46.834 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-08-28T19:22:46.834 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2023-08-28T19:22:46.834 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-08-28T19:22:46.834 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-28T19:22:46.835 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T19:22:46.836 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-08-28T19:22:46.836 DEBUG:teuthology.parallel:result is None 2023-08-28T19:22:47.005 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2023-08-28T19:22:47.006 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-28T19:22:47.031 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-08-28T19:22:47.031 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-28T19:22:47.050 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2023-08-28T19:22:47.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-08-28T19:22:47.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:22:47.151 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-08-28T19:22:47.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-08-28T19:22:47.224 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-08-28T19:22:47.280 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-08-28T19:22:47.280 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-08-28T19:22:47.336 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2023-08-28T19:22:47.336 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2023-08-28T19:22:47.336 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2023-08-28T19:22:47.337 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2023-08-28T19:22:47.337 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2023-08-28T19:22:47.337 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2023-08-28T19:22:47.337 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-28T19:22:47.337 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-08-28T19:22:47.337 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2023-08-28T19:22:47.337 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-28T19:22:47.337 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2023-08-28T19:22:47.338 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T19:22:47.338 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-28T19:22:47.338 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T19:22:47.338 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-08-28T19:22:47.356 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-08-28T19:22:47.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-28T19:22:47.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-28T19:22:47.436 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-08-28T19:22:47.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-28T19:22:47.461 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-08-28T19:22:47.515 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-08-28T19:22:47.516 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-08-28T19:22:47.570 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-08-28T19:22:47.570 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2023-08-28T19:22:47.570 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-08-28T19:22:47.570 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-08-28T19:22:47.570 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2023-08-28T19:22:47.570 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2023-08-28T19:22:47.570 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-28T19:22:47.570 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-08-28T19:22:47.571 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2023-08-28T19:22:47.571 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-28T19:22:47.571 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-08-28T19:22:47.571 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-28T19:22:47.571 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-28T19:22:47.571 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-28T19:22:47.571 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-08-28T19:22:47.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T19:22:47.690 INFO:teuthology.dispatcher.supervisor:Running job 7382206 2023-08-28T19:22:47.691 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382206 --name mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382206/orig.config.yaml 2023-08-28T19:22:47.694 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382206 2023-08-28T19:22:47.694 INFO:teuthology.dispatcher.supervisor:Job PID: 1537415 2023-08-28T19:22:47.694 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-28T19:24:47.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-28T19:24:47.852 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-08-28T19:24:47.957 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-28T19:24:47.958 INFO:teuthology.nuke:Checking targets against current locks 2023-08-28T19:24:48.003 DEBUG:teuthology.nuke:shortname: smithi007 2023-08-28T19:24:48.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-28T19:24:48.023 DEBUG:teuthology.nuke:shortname: smithi193 2023-08-28T19:24:48.023 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-28T19:24:48.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382206', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-28 19:18:04.400379', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOr0/jtVTkYevq1Te6g5LCWFZW675bVGAp21cLNuLbxoPY34urjAXVbgHIdbdRjIf/qM5TOLkWqvl0U1ITsOJNA='} 2023-08-28T19:24:48.044 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-27_15:52:32-rgw-rgw-wip-t62141-valg-supp_i003-distro-default-smithi/7382206', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-28 19:18:04.402353', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKoBhRPeG8uQVb/ZizRNQeOXPc6M2nRm1O26zCg9fQ/CVS9dcfEdkYXd/Nhx5qYCXba5E3PsDaiwQJC0NBFf2O4='} 2023-08-28T19:24:48.071 INFO:teuthology.orchestra.console.smithi007:Power off 2023-08-28T19:24:48.071 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T19:24:48.083 INFO:teuthology.orchestra.console.smithi193:Power off 2023-08-28T19:24:48.083 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-28T19:24:48.092 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-08-28T19:24:48.092 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:24:48.102 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-08-28T19:24:48.102 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-28T19:24:48.112 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-08-28T19:24:48.121 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-28T19:24:48.213 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-08-28T19:24:48.222 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-08-28T19:24:48.361 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2023-08-28T19:24:48.368 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com