2023-12-22T08:33:12.970 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T08:33:12.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:33:13.115 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad66fb2940>, signals=[15]) 2023-12-22T08:33:13.116 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-12-22T08:33:13.116 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T08:33:13.116 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-12-22T08:33:13.144 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-12-22T08:33:13.145 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T08:33:13.145 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-12-22T08:33:13.255 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_8.stream (ID 3) 2023-12-22T08:33:13.277 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_8.stream (ID 3) 2023-12-22T08:33:13.310 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 8.stream 2023-12-22T08:33:13.331 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.stream 2023-12-22T08:33:13.681 INFO:teuthology.orchestra.console.smithi129:Power off 2023-12-22T08:33:13.681 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:33:13.702 INFO:teuthology.orchestra.console.smithi190:Power off 2023-12-22T08:33:13.703 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:33:13.713 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-12-22T08:33:13.713 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:33:13.726 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-12-22T08:33:13.727 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:33:13.737 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-12-22T08:33:13.753 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-22T08:33:13.839 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-12-22T08:33:13.854 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-12-22T08:33:13.940 INFO:teuthology.orchestra.console.smithi129:Power on 2023-12-22T08:33:13.940 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T08:33:13.955 INFO:teuthology.orchestra.console.smithi190:Power on 2023-12-22T08:33:13.956 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T08:33:13.966 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-12-22T08:33:13.967 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:33:13.981 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-12-22T08:33:13.982 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:33:13.997 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-12-22T08:33:14.010 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-22T08:33:18.001 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:33:18.012 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:33:18.111 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-12-22T08:33:18.122 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-22T08:33:22.116 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:33:22.124 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:33:22.226 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-12-22T08:33:22.233 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-22T08:33:22.328 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-12-22T08:33:22.334 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-12-22T08:33:22.429 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-12-22T08:33:22.435 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-12-22T08:35:53.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:35:56.726 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T08:36:02.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:05.813 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T08:36:08.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:11.794 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-12-22T08:36:11.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:14.865 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T08:36:17.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:20.854 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-12-22T08:36:20.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:23.921 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T08:36:26.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:29.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:29.937 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-12-22T08:36:32.977 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T08:36:35.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:38.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:38.997 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-12-22T08:36:42.033 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T08:36:45.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:48.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:48.081 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-12-22T08:36:51.093 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T08:36:54.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:57.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:57.141 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-12-22T08:37:03.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:37:21.557 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-12-22T08:37:27.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:37:30.641 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-12-22T08:37:36.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:37:37.862 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T08:37:37.863 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T08:37:57.100 WARNING:teuthology.provision.fog.smithi190:timed out 2023-12-22T08:38:03.018 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-12-22T08:38:03.018 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-12-22T08:38:03.043 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-12-22T08:38:03.044 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-12-22T08:38:03.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:38:03.105 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-12-22T08:38:03.106 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-12-22T08:38:03.226 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-12-22T08:38:03.258 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-12-22T08:38:03.328 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-12-22T08:38:03.369 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T08:38:03.369 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T08:38:03.397 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-12-22T08:38:03.467 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8" 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8" 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-12-22T08:38:03.526 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-22T08:38:03.527 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:38:03.527 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:38:03.527 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T08:38:03.527 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:38:03.527 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-12-22T08:38:03.529 DEBUG:teuthology.parallel:result is None 2023-12-22T08:38:03.630 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-12-22T08:38:03.630 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-12-22T08:38:03.650 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-12-22T08:38:03.650 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-12-22T08:38:03.709 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-12-22T08:38:03.710 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-12-22T08:38:03.810 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-12-22T08:38:03.839 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-12-22T08:38:03.907 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-12-22T08:38:03.976 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-12-22T08:38:04.042 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-12-22T08:38:04.101 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-22T08:38:04.102 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:38:04.102 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:38:04.102 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T08:38:04.102 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:38:04.102 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-12-22T08:38:04.102 DEBUG:teuthology.parallel:result is None 2023-12-22T08:38:04.252 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-12-22T08:38:04.253 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T08:38:04.282 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-12-22T08:38:04.282 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T08:38:04.299 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-12-22T08:38:04.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-12-22T08:38:04.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:38:04.369 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-12-22T08:38:04.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-12-22T08:38:04.443 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-12-22T08:38:04.504 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-12-22T08:38:04.504 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:38:04.564 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:38:04.565 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T08:38:04.565 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:38:04.565 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-12-22T08:38:04.590 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-12-22T08:38:04.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-22T08:38:04.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:38:04.658 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-12-22T08:38:04.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-22T08:38:04.727 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-12-22T08:38:04.785 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-12-22T08:38:04.785 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-12-22T08:38:04.842 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:38:04.843 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T08:38:04.844 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:38:04.844 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-12-22T08:38:04.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:38:04.968 INFO:teuthology.dispatcher.supervisor:Running job 7499332 2023-12-22T08:38:04.968 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499332 --name rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} -- /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499332/orig.config.yaml 2023-12-22T08:38:04.971 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499332 2023-12-22T08:38:04.972 INFO:teuthology.dispatcher.supervisor:Job PID: 1423358 2023-12-22T08:38:04.972 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-22T08:40:05.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:42:05.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:44:05.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:46:05.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:48:05.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:50:05.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:52:06.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:54:06.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:56:06.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:58:06.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:00:06.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:02:06.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:04:07.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:06:07.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:08:07.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:10:07.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:12:07.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:14:08.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:16:08.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:18:08.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:20:08.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:22:08.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:24:08.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:26:09.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:28:09.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:30:09.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:32:09.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:34:09.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:36:09.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:38:10.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:40:10.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:42:10.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:44:10.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:46:10.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:48:10.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:50:11.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:52:11.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:54:11.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:56:11.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:58:11.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T10:00:12.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T10:02:12.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T10:04:12.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T10:06:12.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T10:08:12.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T10:08:12.865 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-22T10:08:12.974 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-22T10:08:12.974 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T10:08:13.020 DEBUG:teuthology.nuke:shortname: smithi129 2023-12-22T10:08:13.020 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T10:08:13.046 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:33:12.046004', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGOIwcy2rr+uyIyyloYivn2L6qXF2YQQEswELKS2J8bt6S7mSmq1726hUy32j5KsKuij8YS167H1q9B+5q0koOo='} 2023-12-22T10:08:13.048 DEBUG:teuthology.nuke:shortname: smithi190 2023-12-22T10:08:13.048 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T10:08:13.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:33:12.044833', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOVcFG5nrcSZyH+q4fgUaPJqD7LCOW5GjrIxOqDihBs1MhMFmkDy/OLgWxTwK+BDX0CC2s3QgfJ84C9rSovh81g='} 2023-12-22T10:08:13.100 INFO:teuthology.orchestra.console.smithi129:Power off 2023-12-22T10:08:13.100 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T10:08:13.122 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-12-22T10:08:13.122 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:08:13.136 INFO:teuthology.orchestra.console.smithi190:Power off 2023-12-22T10:08:13.136 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T10:08:13.143 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-12-22T10:08:13.154 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-12-22T10:08:13.155 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:08:13.177 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-22T10:08:13.243 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-12-22T10:08:13.278 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-12-22T10:08:13.395 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com 2023-12-22T10:08:13.427 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com