2024-04-17T09:00:18.608 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T09:00:18.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:00:18.802 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd754a3ac10>, signals=[15]) 2024-04-17T09:00:18.803 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2024-04-17T09:00:18.803 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:00:18.803 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-04-17T09:00:18.826 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2024-04-17T09:00:18.826 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:00:18.827 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-04-17T09:00:18.851 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2024-04-17T09:00:18.851 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:00:18.851 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-17T09:00:18.959 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:00:18.963 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:00:18.986 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:00:19.002 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 9.stream 2024-04-17T09:00:19.006 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 9.stream 2024-04-17T09:00:19.024 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 9.stream 2024-04-17T09:00:19.343 INFO:teuthology.orchestra.console.smithi067:Power off 2024-04-17T09:00:19.344 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:00:19.358 INFO:teuthology.orchestra.console.smithi164:Power off 2024-04-17T09:00:19.359 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:00:19.367 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-04-17T09:00:19.368 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:19.384 INFO:teuthology.orchestra.console.smithi123:Power off 2024-04-17T09:00:19.385 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:00:19.393 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-04-17T09:00:19.393 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:19.402 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-04-17T09:00:19.407 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2024-04-17T09:00:19.407 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:19.419 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-17T09:00:19.427 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-04-17T09:00:19.503 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-04-17T09:00:19.520 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-04-17T09:00:19.528 INFO:teuthology.orchestra.console.smithi123:Power off completed 2024-04-17T09:00:19.604 INFO:teuthology.orchestra.console.smithi067:Power on 2024-04-17T09:00:19.605 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:00:19.622 INFO:teuthology.orchestra.console.smithi164:Power on 2024-04-17T09:00:19.622 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:00:19.634 INFO:teuthology.orchestra.console.smithi123:Power on 2024-04-17T09:00:19.635 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:00:19.645 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On 2024-04-17T09:00:19.645 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:19.655 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2024-04-17T09:00:19.655 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:19.666 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2024-04-17T09:00:19.666 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:19.675 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-04-17T09:00:19.680 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-17T09:00:19.687 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-04-17T09:00:23.681 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:23.687 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:23.693 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:23.790 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-04-17T09:00:23.795 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-17T09:00:23.803 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2024-04-17T09:00:23.891 INFO:teuthology.orchestra.console.smithi067:Power on completed 2024-04-17T09:00:23.895 INFO:teuthology.orchestra.console.smithi164:Power on completed 2024-04-17T09:00:23.992 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2024-04-17T09:00:23.996 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2024-04-17T09:00:27.808 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:27.917 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2024-04-17T09:00:28.018 INFO:teuthology.orchestra.console.smithi123:Power on completed 2024-04-17T09:00:28.118 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2024-04-17T09:03:40.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:40.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:43.587 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T09:03:43.587 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-17T09:03:44.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:47.550 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:03:49.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:49.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:52.670 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T09:03:52.671 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-17T09:03:53.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:56.606 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:03:58.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:58.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:01.726 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T09:04:01.727 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-17T09:04:02.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:05.662 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:04:07.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:07.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:10.782 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-17T09:04:10.782 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T09:04:11.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:14.718 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:04:16.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:16.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:19.842 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-17T09:04:19.843 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T09:04:20.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:23.774 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:04:25.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:25.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:28.926 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-17T09:04:28.927 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T09:04:29.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:32.830 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:04:34.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:34.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:37.982 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-17T09:04:37.983 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T09:04:38.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:43.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:43.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:57.374 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:05:03.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:06.466 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:05:12.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:15.550 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-17T09:05:21.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:21.815 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:05:21.815 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:05:42.121 INFO:teuthology.provision.fog.smithi123:Node is ready 2024-04-17T09:05:42.122 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2024-04-17T09:05:42.140 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2024-04-17T09:05:42.141 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2024-04-17T09:05:42.198 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2024-04-17T09:05:42.199 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2024-04-17T09:05:42.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2024-04-17T09:05:42.345 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2024-04-17T09:05:42.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2024-04-17T09:05:42.483 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2024-04-17T09:05:42.550 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-04-17T09:05:42.605 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-04-17T09:05:42.605 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-04-17T09:05:42.605 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-04-17T09:05:42.605 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:05:42.605 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-04-17T09:05:42.605 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:05:42.606 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:05:42.606 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-04-17T09:05:42.606 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:05:42.606 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:05:42.606 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:05:42.606 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:05:42.606 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:05:42.606 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:05:42.607 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2024-04-17T09:05:42.608 DEBUG:teuthology.parallel:result is None 2024-04-17T09:05:43.992 WARNING:teuthology.provision.fog.smithi067:timed out 2024-04-17T09:05:43.992 WARNING:teuthology.provision.fog.smithi164:timed out 2024-04-17T09:05:49.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:50.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:50.220 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:05:50.221 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:05:50.318 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:05:50.318 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:05:50.549 INFO:teuthology.provision.fog.smithi164:Node is ready 2024-04-17T09:05:50.549 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2024-04-17T09:05:50.564 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2024-04-17T09:05:50.564 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2024-04-17T09:05:50.616 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2024-04-17T09:05:50.617 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2024-04-17T09:05:50.646 INFO:teuthology.provision.fog.smithi067:Node is ready 2024-04-17T09:05:50.646 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2024-04-17T09:05:50.660 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2024-04-17T09:05:50.660 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2024-04-17T09:05:50.716 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2024-04-17T09:05:50.716 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2024-04-17T09:05:50.722 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2024-04-17T09:05:50.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2024-04-17T09:05:50.816 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2024-04-17T09:05:50.847 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2024-04-17T09:05:50.878 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2024-04-17T09:05:50.884 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2024-04-17T09:05:50.949 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-17T09:05:50.950 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-04-17T09:05:51.003 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:05:51.004 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:05:51.004 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:05:51.004 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:05:51.004 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:05:51.004 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:05:51.004 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2024-04-17T09:05:51.005 DEBUG:teuthology.parallel:result is None 2024-04-17T09:05:51.021 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2024-04-17T09:05:51.091 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:05:51.147 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:05:51.148 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:05:51.148 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:05:51.148 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2024-04-17T09:05:51.148 DEBUG:teuthology.parallel:result is None 2024-04-17T09:05:51.368 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2024-04-17T09:05:51.368 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:05:51.395 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2024-04-17T09:05:51.395 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:05:51.411 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2024-04-17T09:05:51.412 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:05:51.429 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:05:51.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-17T09:05:51.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:51.537 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-04-17T09:05:51.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-17T09:05:51.605 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-04-17T09:05:51.659 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-04-17T09:05:51.659 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-04-17T09:05:51.714 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-04-17T09:05:51.714 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-04-17T09:05:51.714 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-04-17T09:05:51.714 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:05:51.714 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:05:51.715 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:05:51.715 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-04-17T09:05:51.736 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:05:51.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-17T09:05:51.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:51.828 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-04-17T09:05:51.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-17T09:05:51.898 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-04-17T09:05:51.958 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-04-17T09:05:51.958 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-04-17T09:05:52.017 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-04-17T09:05:52.017 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:05:52.018 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:05:52.019 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-04-17T09:05:52.045 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:05:52.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T09:05:52.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:52.156 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-17T09:05:52.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T09:05:52.227 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-04-17T09:05:52.280 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-04-17T09:05:52.280 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-17T09:05:52.333 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-04-17T09:05:52.333 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-04-17T09:05:52.333 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:05:52.334 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:05:52.335 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-17T09:05:52.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:05:52.458 INFO:teuthology.dispatcher.supervisor:Running job 7659991 2024-04-17T09:05:52.459 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659991 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659991/orig.config.yaml 2024-04-17T09:05:52.461 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659991 2024-04-17T09:05:52.462 INFO:teuthology.dispatcher.supervisor:Job PID: 539974 2024-04-17T09:05:52.462 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T09:07:52.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:09:52.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:11:52.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:13:53.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:15:53.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:17:53.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:17:53.493 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1