2024-04-01T08:19:28.674 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T08:19:28.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T08:19:28.851 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd9168dc10>, signals=[15]) 2024-04-01T08:19:28.852 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2024-04-01T08:19:28.852 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T08:19:28.852 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-04-01T08:19:28.870 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2024-04-01T08:19:28.870 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T08:19:28.870 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-04-01T08:19:28.887 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2024-04-01T08:19:28.887 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T08:19:28.887 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-01T08:19:28.973 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T08:19:28.995 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T08:19:29.021 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T08:19:29.030 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 9.stream 2024-04-01T08:19:29.035 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 9.stream 2024-04-01T08:19:29.056 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2024-04-01T08:19:29.322 INFO:teuthology.orchestra.console.smithi080:Power off 2024-04-01T08:19:29.322 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T08:19:29.335 INFO:teuthology.orchestra.console.smithi131:Power off 2024-04-01T08:19:29.335 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T08:19:29.347 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-04-01T08:19:29.347 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:29.355 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2024-04-01T08:19:29.355 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:29.367 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-04-01T08:19:29.378 INFO:teuthology.orchestra.console.smithi187:Power off 2024-04-01T08:19:29.378 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T08:19:29.386 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-04-01T08:19:29.403 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-04-01T08:19:29.403 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:29.426 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-01T08:19:29.468 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-04-01T08:19:29.487 INFO:teuthology.orchestra.console.smithi131:Power off completed 2024-04-01T08:19:29.526 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-04-01T08:19:29.570 INFO:teuthology.orchestra.console.smithi080:Power on 2024-04-01T08:19:29.570 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T08:19:29.588 INFO:teuthology.orchestra.console.smithi131:Power on 2024-04-01T08:19:29.588 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T08:19:29.596 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2024-04-01T08:19:29.596 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:29.609 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2024-04-01T08:19:29.609 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:29.617 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-04-01T08:19:29.627 INFO:teuthology.orchestra.console.smithi187:Power on 2024-04-01T08:19:29.627 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T08:19:29.635 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-04-01T08:19:29.648 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2024-04-01T08:19:29.648 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:29.669 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-01T08:19:33.619 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:33.636 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:33.670 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:33.729 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-04-01T08:19:33.745 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-04-01T08:19:33.779 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-01T08:19:33.830 INFO:teuthology.orchestra.console.smithi080:Power on completed 2024-04-01T08:19:33.931 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2024-04-01T08:19:37.750 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:37.780 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T08:19:37.859 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-04-01T08:19:37.889 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-04-01T08:19:37.961 INFO:teuthology.orchestra.console.smithi131:Power on completed 2024-04-01T08:19:37.990 INFO:teuthology.orchestra.console.smithi187:Power on completed 2024-04-01T08:19:38.062 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2024-04-01T08:19:38.091 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2024-04-01T08:22:09.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:09.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:12.190 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T08:22:12.191 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-01T08:22:18.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:18.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:20.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:21.246 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T08:22:21.247 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-01T08:22:23.198 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-04-01T08:22:27.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:27.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:29.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:30.334 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T08:22:30.335 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-01T08:22:32.258 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-04-01T08:22:36.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:36.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:38.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:39.390 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T08:22:39.391 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-01T08:22:41.342 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-04-01T08:22:45.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:45.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:47.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:48.446 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T08:22:48.478 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-01T08:22:50.398 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-04-01T08:22:54.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:54.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:56.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:22:57.502 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-01T08:22:57.538 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-01T08:22:59.454 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-04-01T08:23:03.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:23:03.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:23:05.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:23:08.510 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-04-01T08:23:14.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:23:17.566 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-04-01T08:23:23.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:24:03.547 WARNING:teuthology.provision.fog.smithi187:timed out 2024-04-01T08:24:03.547 WARNING:teuthology.provision.fog.smithi131:timed out 2024-04-01T08:24:09.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:24:09.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:24:09.831 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T08:24:09.832 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T08:24:09.865 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T08:24:09.866 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T08:24:10.153 INFO:teuthology.provision.fog.smithi187:Node is ready 2024-04-01T08:24:10.153 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2024-04-01T08:24:10.168 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2024-04-01T08:24:10.168 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2024-04-01T08:24:10.181 INFO:teuthology.provision.fog.smithi131:Node is ready 2024-04-01T08:24:10.181 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2024-04-01T08:24:10.196 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2024-04-01T08:24:10.196 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2024-04-01T08:24:10.223 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2024-04-01T08:24:10.223 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-01T08:24:10.251 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2024-04-01T08:24:10.251 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2024-04-01T08:24:10.320 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2024-04-01T08:24:10.348 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2024-04-01T08:24:10.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2024-04-01T08:24:10.395 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2024-04-01T08:24:10.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2024-04-01T08:24:10.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2024-04-01T08:24:10.482 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-01T08:24:10.529 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2024-04-01T08:24:10.548 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-01T08:24:10.595 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-04-01T08:24:10.602 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-01T08:24:10.602 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T08:24:10.603 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T08:24:10.604 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2024-04-01T08:24:10.605 DEBUG:teuthology.parallel:result is None 2024-04-01T08:24:10.649 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T08:24:10.650 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T08:24:10.651 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2024-04-01T08:24:10.651 DEBUG:teuthology.parallel:result is None 2024-04-01T08:24:23.582 WARNING:teuthology.provision.fog.smithi080:timed out 2024-04-01T08:24:29.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:24:29.823 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T08:24:29.823 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T08:24:30.169 INFO:teuthology.provision.fog.smithi080:Node is ready 2024-04-01T08:24:30.169 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2024-04-01T08:24:30.184 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2024-04-01T08:24:30.184 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2024-04-01T08:24:30.240 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2024-04-01T08:24:30.241 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-04-01T08:24:30.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2024-04-01T08:24:30.374 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2024-04-01T08:24:30.446 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2024-04-01T08:24:30.516 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-04-01T08:24:30.586 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-04-01T08:24:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-04-01T08:24:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-04-01T08:24:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-04-01T08:24:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-04-01T08:24:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-04-01T08:24:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-04-01T08:24:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T08:24:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-04-01T08:24:30.645 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-04-01T08:24:30.645 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T08:24:30.645 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-04-01T08:24:30.645 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T08:24:30.645 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T08:24:30.645 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T08:24:30.645 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2024-04-01T08:24:30.646 DEBUG:teuthology.parallel:result is None 2024-04-01T08:24:30.854 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2024-04-01T08:24:30.854 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T08:24:30.875 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2024-04-01T08:24:30.875 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T08:24:30.900 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2024-04-01T08:24:30.900 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T08:24:30.927 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2024-04-01T08:24:30.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-01T08:24:30.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:24:31.016 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-04-01T08:24:31.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-01T08:24:31.084 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-04-01T08:24:31.142 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-04-01T08:24:31.142 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-04-01T08:24:31.200 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-04-01T08:24:31.200 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-04-01T08:24:31.200 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-04-01T08:24:31.200 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-04-01T08:24:31.200 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-04-01T08:24:31.200 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-04-01T08:24:31.201 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T08:24:31.201 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-04-01T08:24:31.201 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-04-01T08:24:31.201 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T08:24:31.201 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-04-01T08:24:31.201 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T08:24:31.201 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T08:24:31.201 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T08:24:31.201 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-04-01T08:24:31.225 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2024-04-01T08:24:31.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-01T08:24:31.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:24:31.315 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-04-01T08:24:31.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-01T08:24:31.485 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-04-01T08:24:31.539 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-04-01T08:24:31.540 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-04-01T08:24:31.594 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-04-01T08:24:31.594 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-04-01T08:24:31.594 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T08:24:31.595 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T08:24:31.596 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-04-01T08:24:31.617 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2024-04-01T08:24:31.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-01T08:24:31.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T08:24:31.705 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-01T08:24:31.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-01T08:24:31.872 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-04-01T08:24:31.927 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-04-01T08:24:31.927 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-01T08:24:31.981 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-01T08:24:31.981 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-04-01T08:24:31.981 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-01T08:24:31.981 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-01T08:24:31.981 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-04-01T08:24:31.981 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-04-01T08:24:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T08:24:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-01T08:24:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-04-01T08:24:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T08:24:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-01T08:24:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T08:24:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T08:24:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T08:24:31.982 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-01T08:24:32.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T08:24:32.106 INFO:teuthology.dispatcher.supervisor:Running job 7632160 2024-04-01T08:24:32.106 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632160 --name pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632160/orig.config.yaml 2024-04-01T08:24:32.109 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632160 2024-04-01T08:24:32.110 INFO:teuthology.dispatcher.supervisor:Job PID: 1293718 2024-04-01T08:24:32.110 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T08:26:32.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T08:28:32.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T08:30:32.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T08:32:32.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T08:34:32.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T08:36:33.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T08:36:33.121 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1