2024-01-23T21:26:18.739 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-23T21:26:18.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:26:18.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb853f59c10>, signals=[15]) 2024-01-23T21:26:18.870 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-01-23T21:26:18.870 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T21:26:18.870 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-01-23T21:26:18.901 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2024-01-23T21:26:18.901 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T21:26:18.901 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-01-23T21:26:19.004 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2024-01-23T21:26:19.023 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10) 2024-01-23T21:26:19.042 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2024-01-23T21:26:19.075 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream 2024-01-23T21:26:19.322 INFO:teuthology.orchestra.console.smithi161:Power off 2024-01-23T21:26:19.322 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T21:26:19.344 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-01-23T21:26:19.345 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:19.369 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-23T21:26:19.381 INFO:teuthology.orchestra.console.smithi175:Power off 2024-01-23T21:26:19.381 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T21:26:19.404 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-01-23T21:26:19.404 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:19.427 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-01-23T21:26:23.372 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:23.428 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:23.482 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-23T21:26:23.537 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-01-23T21:26:27.484 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:27.537 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:27.593 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-23T21:26:27.646 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-23T21:26:27.747 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-01-23T21:26:27.847 INFO:teuthology.orchestra.console.smithi175:Power on 2024-01-23T21:26:27.848 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T21:26:27.870 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2024-01-23T21:26:27.870 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:27.892 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-23T21:26:31.598 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:31.709 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-23T21:26:31.810 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-01-23T21:26:31.893 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:31.913 INFO:teuthology.orchestra.console.smithi161:Power on 2024-01-23T21:26:31.913 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T21:26:31.935 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-01-23T21:26:31.936 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:31.956 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-23T21:26:32.002 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-23T21:26:35.960 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:36.003 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T21:26:36.070 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-23T21:26:36.113 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-01-23T21:26:36.171 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-01-23T21:26:36.213 INFO:teuthology.orchestra.console.smithi175:Power on completed 2024-01-23T21:26:36.272 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-01-23T21:26:36.314 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2024-01-23T21:29:07.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:10.524 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-23T21:29:16.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:19.584 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-23T21:29:22.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:25.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:25.628 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:29:28.668 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-23T21:29:31.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:34.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:34.684 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:29:37.724 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-23T21:29:40.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:43.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:43.740 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:29:46.780 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-23T21:29:49.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:52.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:29:52.800 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:29:55.836 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-23T21:29:58.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:30:01.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:30:01.884 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:30:07.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:30:10.940 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:30:16.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:30:35.452 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:30:41.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:30:44.544 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:30:50.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:30:53.632 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-23T21:30:59.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:30:59.926 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T21:30:59.926 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T21:31:01.842 WARNING:teuthology.provision.fog.smithi175:timed out 2024-01-23T21:31:07.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:31:08.230 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T21:31:08.231 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T21:31:08.556 INFO:teuthology.provision.fog.smithi175:Node is ready 2024-01-23T21:31:08.556 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2024-01-23T21:31:08.570 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2024-01-23T21:31:08.571 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2024-01-23T21:31:08.625 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2024-01-23T21:31:08.625 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-01-23T21:31:08.730 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2024-01-23T21:31:08.757 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2024-01-23T21:31:08.825 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2024-01-23T21:31:08.892 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-01-23T21:31:08.958 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-01-23T21:31:09.012 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-01-23T21:31:09.012 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-01-23T21:31:09.012 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-01-23T21:31:09.012 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T21:31:09.013 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T21:31:09.014 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2024-01-23T21:31:09.015 DEBUG:teuthology.parallel:result is None 2024-01-23T21:31:20.252 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-01-23T21:31:20.252 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-01-23T21:31:20.271 INFO:teuthology.orchestra.run.smithi161.stdout:smithi046 2024-01-23T21:31:20.271 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi046 /etc/hosts 2024-01-23T21:31:20.329 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-01-23T21:31:20.329 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-01-23T21:31:20.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi046/smithi161/g' /etc/hosts 2024-01-23T21:31:20.514 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.46/172.21.15.161/g' /etc/hosts 2024-01-23T21:31:20.585 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi046/smithi161/g' /etc/hostname 2024-01-23T21:31:20.655 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-01-23T21:31:20.722 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-01-23T21:31:20.778 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-01-23T21:31:20.778 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-01-23T21:31:20.778 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-01-23T21:31:20.778 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-01-23T21:31:20.778 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T21:31:20.779 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T21:31:20.779 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-01-23T21:31:20.780 DEBUG:teuthology.parallel:result is None 2024-01-23T21:31:20.949 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-01-23T21:31:20.949 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T21:31:20.967 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2024-01-23T21:31:20.967 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T21:31:21.026 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-01-23T21:31:21.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-23T21:31:21.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:31:21.111 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-01-23T21:31:21.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-23T21:31:21.178 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-01-23T21:31:21.232 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-01-23T21:31:21.233 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-01-23T21:31:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-01-23T21:31:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-01-23T21:31:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-01-23T21:31:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-01-23T21:31:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-01-23T21:31:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-01-23T21:31:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T21:31:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-01-23T21:31:21.288 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-01-23T21:31:21.288 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T21:31:21.288 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-01-23T21:31:21.288 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T21:31:21.288 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T21:31:21.288 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T21:31:21.288 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-01-23T21:31:21.311 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2024-01-23T21:31:21.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-23T21:31:21.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T21:31:21.402 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-01-23T21:31:21.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-23T21:31:21.570 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-01-23T21:31:21.624 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-01-23T21:31:21.624 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-01-23T21:31:21.679 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-01-23T21:31:21.679 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-01-23T21:31:21.679 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T21:31:21.680 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T21:31:21.681 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-01-23T21:31:21.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:31:21.836 INFO:teuthology.dispatcher.supervisor:Running job 7528882 2024-01-23T21:31:21.836 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-23_16:13:27-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7528882 --name yuriw-2024-01-23_16:13:27-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2024-01-23_16:13:27-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7528882/orig.config.yaml 2024-01-23T21:31:21.840 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-23_16:13:27-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7528882 2024-01-23T21:31:21.840 INFO:teuthology.dispatcher.supervisor:Job PID: 2096377 2024-01-23T21:31:21.840 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-23T21:33:21.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:35:22.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:37:22.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:39:22.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:41:22.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:43:22.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:45:22.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:47:23.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:49:23.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:51:23.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:53:23.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:55:23.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:57:23.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T21:59:24.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:01:24.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:03:24.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:05:24.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:07:24.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:09:24.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:11:25.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:13:25.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:15:25.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:17:25.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:19:25.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:21:25.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:23:26.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:25:26.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:27:26.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:29:26.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:31:26.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:33:26.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:35:27.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:37:27.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:39:27.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:41:27.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:43:27.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:45:28.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:47:28.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:49:28.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:51:28.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:53:28.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:55:28.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:57:28.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T22:59:29.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:01:29.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:03:29.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:05:29.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:07:29.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:09:29.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:11:30.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:13:30.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:15:30.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:17:30.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:19:30.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:21:31.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:23:31.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:25:31.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:27:31.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:29:31.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:31:31.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:33:31.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:35:32.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:37:32.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:39:32.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:41:32.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T23:41:32.714 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-23T23:41:32.873 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-23T23:41:32.873 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T23:41:32.919 DEBUG:teuthology.nuke:shortname: smithi161 2024-01-23T23:41:32.919 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T23:41:32.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-23_16:13:27-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7528882', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 21:26:17.745999', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3xUbezAq3WAT5SD0OxmhadKHIjMeKFXF7/jhLLFwa2hLjZUwNlswYm72KkzCwAiEfioApSTwA4Kc/4lAjQHtw='} 2024-01-23T23:41:32.945 DEBUG:teuthology.nuke:shortname: smithi175 2024-01-23T23:41:32.945 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T23:41:32.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-23_16:13:27-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7528882', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 21:26:17.744246', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJDhvZhlodEjqbSsbPF0XCBXKx/hIgBk3ITnE8/T1QoAV502FHETU+RmGpgX22rjxUGSJmZfthceC9r1xYtnm0='} 2024-01-23T23:41:32.999 INFO:teuthology.orchestra.console.smithi161:Power off 2024-01-23T23:41:32.999 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T23:41:33.022 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-01-23T23:41:33.023 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T23:41:33.040 INFO:teuthology.orchestra.console.smithi175:Power off 2024-01-23T23:41:33.040 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T23:41:33.049 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-23T23:41:33.061 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-01-23T23:41:33.061 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T23:41:33.084 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-23T23:41:33.150 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-01-23T23:41:33.185 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-01-23T23:41:33.305 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2024-01-23T23:41:33.329 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com