2024-01-23T00:26:55.925 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-23T00:26:55.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:26:56.065 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4cb8f97c10>, signals=[15]) 2024-01-23T00:26:56.066 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2024-01-23T00:26:56.066 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T00:26:56.066 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-01-23T00:26:56.086 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2024-01-23T00:26:56.086 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T00:26:56.086 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-01-23T00:26:56.218 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_centos_9.stream (ID 10) 2024-01-23T00:26:56.220 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_9.stream (ID 10) 2024-01-23T00:26:56.266 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 9.stream 2024-01-23T00:26:56.269 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 9.stream 2024-01-23T00:26:56.494 INFO:teuthology.orchestra.console.smithi067:Power off 2024-01-23T00:26:56.494 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T00:26:56.507 INFO:teuthology.orchestra.console.smithi006:Power off 2024-01-23T00:26:56.507 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T00:26:56.517 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-01-23T00:26:56.517 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:26:56.528 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-01-23T00:26:56.528 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:26:56.537 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-23T00:26:56.548 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-01-23T00:27:00.541 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:00.549 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:00.651 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-23T00:27:00.657 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-01-23T00:27:04.656 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:04.663 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:04.765 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-23T00:27:04.771 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-01-23T00:27:04.871 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-01-23T00:27:04.972 INFO:teuthology.orchestra.console.smithi006:Power on 2024-01-23T00:27:04.972 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T00:27:04.992 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2024-01-23T00:27:04.992 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:05.011 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-01-23T00:27:08.770 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:08.880 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-23T00:27:08.981 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-01-23T00:27:09.012 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:09.082 INFO:teuthology.orchestra.console.smithi067:Power on 2024-01-23T00:27:09.083 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T00:27:09.102 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On 2024-01-23T00:27:09.103 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:09.121 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-01-23T00:27:09.122 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-23T00:27:13.125 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:13.131 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:13.234 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-01-23T00:27:13.239 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-23T00:27:13.335 INFO:teuthology.orchestra.console.smithi006:Power on completed 2024-01-23T00:27:13.436 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2024-01-23T00:27:17.240 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:27:17.349 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-23T00:27:17.449 INFO:teuthology.orchestra.console.smithi067:Power on completed 2024-01-23T00:27:17.550 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2024-01-23T00:29:44.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:29:48.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:02.556 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-01-23T00:30:06.652 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-23T00:30:08.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:11.612 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-01-23T00:30:12.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:15.708 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-23T00:30:17.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:20.668 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-01-23T00:30:21.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:24.764 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-23T00:30:26.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:29.724 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-01-23T00:30:30.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:33.820 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-23T00:30:35.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:39.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:30:42.876 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-23T00:30:48.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:31:35.777 WARNING:teuthology.provision.fog.smithi006:timed out 2024-01-23T00:31:41.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:31:42.071 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T00:31:42.072 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T00:31:42.413 INFO:teuthology.provision.fog.smithi006:Node is ready 2024-01-23T00:31:42.413 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2024-01-23T00:31:42.429 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2024-01-23T00:31:42.429 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2024-01-23T00:31:42.485 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2024-01-23T00:31:42.485 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-01-23T00:31:42.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2024-01-23T00:31:42.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2024-01-23T00:31:42.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2024-01-23T00:31:42.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-01-23T00:31:42.859 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T00:31:42.914 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T00:31:42.915 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T00:31:42.915 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2024-01-23T00:31:42.917 DEBUG:teuthology.parallel:result is None 2024-01-23T00:31:48.889 WARNING:teuthology.provision.fog.smithi067:timed out 2024-01-23T00:31:54.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:31:55.150 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T00:31:55.151 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T00:31:55.479 INFO:teuthology.provision.fog.smithi067:Node is ready 2024-01-23T00:31:55.480 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2024-01-23T00:31:55.496 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2024-01-23T00:31:55.496 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2024-01-23T00:31:55.551 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2024-01-23T00:31:55.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2024-01-23T00:31:55.655 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2024-01-23T00:31:55.687 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2024-01-23T00:31:55.757 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2024-01-23T00:31:55.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2024-01-23T00:31:55.899 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-01-23T00:31:55.954 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T00:31:55.955 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T00:31:55.955 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T00:31:55.955 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2024-01-23T00:31:55.956 DEBUG:teuthology.parallel:result is None 2024-01-23T00:31:56.135 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2024-01-23T00:31:56.135 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T00:31:56.162 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2024-01-23T00:31:56.162 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T00:31:56.189 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2024-01-23T00:31:56.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-01-23T00:31:56.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:31:56.293 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-01-23T00:31:56.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-01-23T00:31:56.470 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-01-23T00:31:56.525 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-01-23T00:31:56.525 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-01-23T00:31:56.580 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-01-23T00:31:56.580 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-01-23T00:31:56.580 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-01-23T00:31:56.580 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-01-23T00:31:56.580 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-01-23T00:31:56.580 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-01-23T00:31:56.580 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T00:31:56.581 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-01-23T00:31:56.581 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-01-23T00:31:56.581 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T00:31:56.581 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-01-23T00:31:56.581 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T00:31:56.581 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T00:31:56.581 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T00:31:56.581 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-01-23T00:31:56.604 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2024-01-23T00:31:56.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-23T00:31:56.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:31:56.705 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-01-23T00:31:56.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-23T00:31:56.775 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-01-23T00:31:56.829 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-01-23T00:31:56.830 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T00:31:56.885 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-01-23T00:31:56.886 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T00:31:56.886 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T00:31:56.886 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T00:31:56.886 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-01-23T00:31:56.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:31:56.992 INFO:teuthology.dispatcher.supervisor:Running job 7527476 2024-01-23T00:31:56.992 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527476 --name sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} -- /home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527476/orig.config.yaml 2024-01-23T00:31:56.995 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527476 2024-01-23T00:31:56.996 INFO:teuthology.dispatcher.supervisor:Job PID: 102507 2024-01-23T00:31:56.996 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-23T00:33:57.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:35:57.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:37:57.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:39:57.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:41:57.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:43:58.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:45:58.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:45:58.273 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-23T00:45:58.425 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-23T00:45:58.425 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T00:45:58.478 DEBUG:teuthology.nuke:shortname: smithi006 2024-01-23T00:45:58.478 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T00:45:58.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527476', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 00:26:54.923324', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnN0quWyXPOVhandV8473xvB+rNW7SmvC0GYGVP41DDhlkrRa0QrgggpcMJYD49THrrcLCIWy3EGAMbvVph77M='} 2024-01-23T00:45:58.504 DEBUG:teuthology.nuke:shortname: smithi067 2024-01-23T00:45:58.504 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T00:45:58.527 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527476', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 00:26:54.924961', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPiTW4/UPugIDJy5+1Np6irRa297NZZxrsb0QtCqBkpmL0IjjfQI5YSl6bUHHpHe+qUVVae8HJrjCCK4tj1ALA='} 2024-01-23T00:45:58.548 INFO:teuthology.orchestra.console.smithi006:Power off 2024-01-23T00:45:58.548 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T00:45:58.572 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-01-23T00:45:58.572 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:45:58.589 INFO:teuthology.orchestra.console.smithi067:Power off 2024-01-23T00:45:58.589 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T00:45:58.597 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-01-23T00:45:58.609 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-01-23T00:45:58.610 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:45:58.632 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-23T00:45:58.697 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-01-23T00:45:58.733 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-01-23T00:45:58.847 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2024-01-23T00:45:58.879 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com