2023-11-23T06:52:04.339 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-23T06:52:04.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T06:52:04.469 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6da7686c10>, signals=[15]) 2023-11-23T06:52:04.469 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2023-11-23T06:52:04.469 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T06:52:04.470 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-11-23T06:52:04.493 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2023-11-23T06:52:04.493 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T06:52:04.494 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-11-23T06:52:04.602 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_9.stream (ID 10) 2023-11-23T06:52:04.620 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10) 2023-11-23T06:52:04.648 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 9.stream 2023-11-23T06:52:04.661 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream 2023-11-23T06:52:05.145 INFO:teuthology.orchestra.console.smithi121:Power off 2023-11-23T06:52:05.146 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T06:52:05.158 INFO:teuthology.orchestra.console.smithi177:Power off 2023-11-23T06:52:05.158 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T06:52:05.165 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-11-23T06:52:05.166 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T06:52:05.181 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-11-23T06:52:05.181 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T06:52:05.188 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-11-23T06:52:05.200 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-23T06:52:05.289 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-11-23T06:52:05.301 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-11-23T06:52:05.390 INFO:teuthology.orchestra.console.smithi121:Power on 2023-11-23T06:52:05.390 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T06:52:05.402 INFO:teuthology.orchestra.console.smithi177:Power on 2023-11-23T06:52:05.402 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T06:52:05.409 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2023-11-23T06:52:05.410 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T06:52:05.422 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2023-11-23T06:52:05.422 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T06:52:05.430 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-11-23T06:52:05.443 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-23T06:52:09.434 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T06:52:09.443 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T06:52:09.542 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-11-23T06:52:09.551 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-23T06:52:09.644 INFO:teuthology.orchestra.console.smithi121:Power on completed 2023-11-23T06:52:09.652 INFO:teuthology.orchestra.console.smithi177:Power on completed 2023-11-23T06:52:09.745 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2023-11-23T06:52:09.754 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2023-11-23T07:00:21.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:00:24.450 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:00:30.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:00:33.510 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:00:37.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:00:39.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:00:40.066 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-23T07:00:42.594 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:00:46.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:00:48.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:00:49.126 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-23T07:00:51.654 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:00:55.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:00:57.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:00:58.210 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-23T07:01:00.738 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:01:04.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:06.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:07.269 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-23T07:01:09.798 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:01:13.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:15.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:16.354 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-23T07:01:22.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:25.410 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-23T07:01:25.986 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:01:31.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:31.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:34.466 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-23T07:01:35.042 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:01:40.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:41.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:44.098 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-11-23T07:01:50.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:01:52.377 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T07:01:52.377 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T07:02:12.737 INFO:teuthology.provision.fog.smithi121:Node is ready 2023-11-23T07:02:12.737 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2023-11-23T07:02:12.754 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2023-11-23T07:02:12.754 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2023-11-23T07:02:12.811 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2023-11-23T07:02:12.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-11-23T07:02:12.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2023-11-23T07:02:12.986 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2023-11-23T07:02:13.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2023-11-23T07:02:13.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-11-23T07:02:13.191 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-11-23T07:02:13.246 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2023-11-23T07:02:13.246 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2023-11-23T07:02:13.246 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2023-11-23T07:02:13.246 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-23T07:02:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T07:02:13.248 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2023-11-23T07:02:13.249 DEBUG:teuthology.parallel:result is None 2023-11-23T07:02:40.498 WARNING:teuthology.provision.fog.smithi177:timed out 2023-11-23T07:02:46.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:02:46.693 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T07:02:46.693 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T07:02:47.015 INFO:teuthology.provision.fog.smithi177:Node is ready 2023-11-23T07:02:47.016 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2023-11-23T07:02:47.030 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2023-11-23T07:02:47.031 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2023-11-23T07:02:47.090 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2023-11-23T07:02:47.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-11-23T07:02:47.200 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2023-11-23T07:02:47.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2023-11-23T07:02:47.300 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2023-11-23T07:02:47.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-11-23T07:02:47.442 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-11-23T07:02:47.500 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-11-23T07:02:47.500 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2023-11-23T07:02:47.500 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-11-23T07:02:47.500 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-11-23T07:02:47.500 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2023-11-23T07:02:47.500 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2023-11-23T07:02:47.500 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-23T07:02:47.501 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-11-23T07:02:47.501 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2023-11-23T07:02:47.501 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-23T07:02:47.501 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-11-23T07:02:47.501 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T07:02:47.501 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-23T07:02:47.501 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T07:02:47.501 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2023-11-23T07:02:47.502 DEBUG:teuthology.parallel:result is None 2023-11-23T07:02:47.679 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2023-11-23T07:02:47.679 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-23T07:02:47.709 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2023-11-23T07:02:47.709 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-23T07:02:47.735 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2023-11-23T07:02:47.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-11-23T07:02:47.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:02:47.819 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-11-23T07:02:47.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-11-23T07:02:47.993 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-11-23T07:02:48.047 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-11-23T07:02:48.047 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-11-23T07:02:48.102 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-23T07:02:48.103 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2023-11-23T07:02:48.104 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T07:02:48.104 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-23T07:02:48.104 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T07:02:48.104 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-11-23T07:02:48.126 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2023-11-23T07:02:48.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-23T07:02:48.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T07:02:48.214 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-11-23T07:02:48.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-23T07:02:48.280 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-11-23T07:02:48.337 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-11-23T07:02:48.338 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-11-23T07:02:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-11-23T07:02:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2023-11-23T07:02:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-11-23T07:02:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-11-23T07:02:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2023-11-23T07:02:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2023-11-23T07:02:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-23T07:02:48.398 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-11-23T07:02:48.398 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2023-11-23T07:02:48.398 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-23T07:02:48.398 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-11-23T07:02:48.398 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T07:02:48.398 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-23T07:02:48.398 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T07:02:48.399 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-11-23T07:02:48.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:02:48.526 INFO:teuthology.dispatcher.supervisor:Running job 7464681 2023-11-23T07:02:48.527 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-11-23_06:51:28-rgw-wip-rgw-d3n-filter-distro-default-smithi/7464681 --name prsrivas-2023-11-23_06:51:28-rgw-wip-rgw-d3n-filter-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/prsrivas-2023-11-23_06:51:28-rgw-wip-rgw-d3n-filter-distro-default-smithi/7464681/orig.config.yaml 2023-11-23T07:02:48.530 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-11-23_06:51:28-rgw-wip-rgw-d3n-filter-distro-default-smithi/7464681 2023-11-23T07:02:48.531 INFO:teuthology.dispatcher.supervisor:Job PID: 1990329 2023-11-23T07:02:48.531 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-23T07:04:48.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:06:48.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:08:48.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:10:49.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:12:49.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:14:49.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:16:49.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:18:49.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:20:50.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:22:50.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:24:50.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:26:50.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:28:50.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:30:50.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:32:51.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:34:51.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:36:51.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:38:51.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:40:51.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:42:51.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:44:51.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:46:55.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:48:55.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:50:55.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:52:55.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:54:55.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:56:56.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T07:58:56.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T08:00:56.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T08:02:56.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T08:04:56.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T08:06:56.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T08:08:58.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T08:08:58.642 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-23T08:08:58.803 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-23T08:08:58.803 INFO:teuthology.nuke:Checking targets against current locks 2023-11-23T08:08:58.847 DEBUG:teuthology.nuke:shortname: smithi121 2023-11-23T08:08:58.847 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T08:08:58.866 DEBUG:teuthology.nuke:shortname: smithi177 2023-11-23T08:08:58.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T08:08:58.879 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-11-23_06:51:28-rgw-wip-rgw-d3n-filter-distro-default-smithi/7464681', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 06:52:03.557438', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOBsim3TQdk1fsolHkUF/Ic8rgmseX/nJr3ShwndUp+4id149mJ5B7zhXVCmeGlM6XYLEZJoAfg/iujgF/V4v8='} 2023-11-23T08:08:58.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-11-23_06:51:28-rgw-wip-rgw-d3n-filter-distro-default-smithi/7464681', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 06:52:03.558638', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJkw/nv//6A+Pu+8txW2ZnBIAr5D7GJ7NsRRXC7qdhRQmvOWxcPQ6qQJmosEoxmim46yJ1DcFUwUxQX+vSasyoI='} 2023-11-23T08:08:58.923 INFO:teuthology.orchestra.console.smithi121:Power off 2023-11-23T08:08:58.923 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T08:08:58.936 INFO:teuthology.orchestra.console.smithi177:Power off 2023-11-23T08:08:58.936 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T08:08:58.945 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-11-23T08:08:58.945 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T08:08:58.956 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-11-23T08:08:58.957 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T08:08:58.965 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-11-23T08:08:58.976 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-23T08:08:59.066 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-11-23T08:08:59.076 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-11-23T08:08:59.215 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com 2023-11-23T08:08:59.224 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com