2024-04-17T09:15:49.332 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T09:15:49.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:15:49.512 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc475158c10>, signals=[15]) 2024-04-17T09:15:49.513 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2024-04-17T09:15:49.513 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:15:49.513 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-04-17T09:15:49.539 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-04-17T09:15:49.539 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:15:49.540 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-04-17T09:15:49.563 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2024-04-17T09:15:49.564 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:15:49.564 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-17T09:15:49.635 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:15:49.682 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:15:49.685 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 9.stream 2024-04-17T09:15:49.691 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:15:49.732 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream 2024-04-17T09:15:49.735 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream 2024-04-17T09:15:49.793 DEBUG:teuthology.provision.fog.smithi008:Canceling deploy task with ID 966668 2024-04-17T09:15:49.836 DEBUG:teuthology.provision.fog.smithi154:Canceling deploy task with ID 966670 2024-04-17T09:15:50.078 INFO:teuthology.orchestra.console.smithi084:Power off 2024-04-17T09:15:50.079 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:15:50.104 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-04-17T09:15:50.104 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:50.124 INFO:teuthology.orchestra.console.smithi008:Power off 2024-04-17T09:15:50.125 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:15:50.136 INFO:teuthology.orchestra.console.smithi154:Power off 2024-04-17T09:15:50.137 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:15:50.143 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-04-17T09:15:50.144 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-04-17T09:15:50.145 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:50.157 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-04-17T09:15:50.158 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:50.167 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-04-17T09:15:50.180 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-17T09:15:50.245 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-04-17T09:15:50.268 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-04-17T09:15:50.281 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-04-17T09:15:50.346 INFO:teuthology.orchestra.console.smithi084:Power on 2024-04-17T09:15:50.346 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:15:50.368 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-04-17T09:15:50.368 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:50.375 INFO:teuthology.orchestra.console.smithi008:Power on 2024-04-17T09:15:50.376 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:15:50.382 INFO:teuthology.orchestra.console.smithi154:Power on 2024-04-17T09:15:50.382 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:15:50.390 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-04-17T09:15:50.405 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2024-04-17T09:15:50.405 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:50.414 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2024-04-17T09:15:50.414 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:50.426 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-04-17T09:15:50.435 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-17T09:15:54.397 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:54.427 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:54.435 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:54.507 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-04-17T09:15:54.536 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-04-17T09:15:54.544 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-17T09:15:58.511 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:58.537 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:58.545 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:15:58.620 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-04-17T09:15:58.645 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-04-17T09:15:58.654 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-17T09:15:58.721 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-04-17T09:15:58.746 INFO:teuthology.orchestra.console.smithi008:Power on completed 2024-04-17T09:15:58.755 INFO:teuthology.orchestra.console.smithi154:Power on completed 2024-04-17T09:15:58.822 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-04-17T09:15:58.847 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2024-04-17T09:15:58.856 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2024-04-17T09:18:30.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:19:30.148 WARNING:teuthology.provision.fog.smithi008:timed out 2024-04-17T09:19:30.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:19:30.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:19:33.534 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:19:36.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:19:39.230 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-17T09:19:39.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:19:42.590 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:19:45.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:19:48.287 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-17T09:19:48.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:19:51.646 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:19:54.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:19:57.342 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-17T09:19:57.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:00.702 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:20:03.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:03.658 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:20:03.659 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:20:05.150 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-17T09:20:06.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:09.758 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:20:11.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:14.206 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-17T09:20:15.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:18.248 INFO:teuthology.provision.fog.smithi008:Node is ready 2024-04-17T09:20:18.248 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2024-04-17T09:20:18.269 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2024-04-17T09:20:18.269 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2024-04-17T09:20:18.328 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2024-04-17T09:20:18.329 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-04-17T09:20:18.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2024-04-17T09:20:18.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2024-04-17T09:20:18.580 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2024-04-17T09:20:18.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-04-17T09:20:18.735 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-04-17T09:20:18.791 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-04-17T09:20:18.791 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-04-17T09:20:18.791 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-04-17T09:20:18.791 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:20:18.791 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:20:18.792 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:20:18.793 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2024-04-17T09:20:18.795 DEBUG:teuthology.parallel:result is None 2024-04-17T09:20:18.814 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:20:20.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:23.262 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-17T09:20:24.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:29.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:43.294 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:20:49.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:20:52.386 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:20:58.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:21:01.470 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-17T09:21:07.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:21:07.682 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:21:07.682 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:21:23.199 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-04-17T09:21:23.199 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-04-17T09:21:23.217 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-04-17T09:21:23.217 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-04-17T09:21:23.275 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-04-17T09:21:23.275 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-04-17T09:21:23.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-04-17T09:21:23.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-04-17T09:21:23.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-04-17T09:21:23.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-04-17T09:21:23.644 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-04-17T09:21:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-04-17T09:21:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:21:23.699 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:21:23.700 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-04-17T09:21:23.700 DEBUG:teuthology.parallel:result is None 2024-04-17T09:21:29.274 WARNING:teuthology.provision.fog.smithi154:timed out 2024-04-17T09:21:35.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:21:35.508 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:21:35.508 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:21:35.827 INFO:teuthology.provision.fog.smithi154:Node is ready 2024-04-17T09:21:35.828 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2024-04-17T09:21:35.843 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2024-04-17T09:21:35.843 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2024-04-17T09:21:35.899 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2024-04-17T09:21:35.899 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2024-04-17T09:21:36.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2024-04-17T09:21:36.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2024-04-17T09:21:36.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2024-04-17T09:21:36.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2024-04-17T09:21:36.240 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:21:36.295 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:21:36.296 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:21:36.296 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2024-04-17T09:21:36.296 DEBUG:teuthology.parallel:result is None 2024-04-17T09:21:36.508 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2024-04-17T09:21:36.509 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:21:36.531 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-04-17T09:21:36.531 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:21:36.547 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2024-04-17T09:21:36.547 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:21:36.569 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:21:36.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-04-17T09:21:36.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:21:36.721 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-04-17T09:21:36.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-04-17T09:21:36.901 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-04-17T09:21:36.955 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-04-17T09:21:36.955 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-04-17T09:21:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-04-17T09:21:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-04-17T09:21:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-04-17T09:21:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:21:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-04-17T09:21:37.010 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:21:37.011 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:21:37.011 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-04-17T09:21:37.011 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:21:37.011 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:21:37.011 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:21:37.011 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:21:37.011 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:21:37.011 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:21:37.011 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-04-17T09:21:37.031 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:21:37.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-17T09:21:37.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:21:37.123 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-04-17T09:21:37.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-17T09:21:37.293 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-04-17T09:21:37.347 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-04-17T09:21:37.347 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-04-17T09:21:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-04-17T09:21:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-04-17T09:21:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-04-17T09:21:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:21:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-04-17T09:21:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:21:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:21:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-04-17T09:21:37.403 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:21:37.403 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:21:37.403 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:21:37.403 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:21:37.403 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:21:37.403 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:21:37.403 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-04-17T09:21:37.431 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:21:37.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-17T09:21:37.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:21:37.516 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-17T09:21:37.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-17T09:21:37.587 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-04-17T09:21:37.643 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-04-17T09:21:37.643 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-17T09:21:37.701 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-04-17T09:21:37.701 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-04-17T09:21:37.701 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:21:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:21:37.703 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-17T09:21:37.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:21:37.819 INFO:teuthology.dispatcher.supervisor:Running job 7660012 2024-04-17T09:21:37.819 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660012 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660012/orig.config.yaml 2024-04-17T09:21:37.822 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660012 2024-04-17T09:21:37.823 INFO:teuthology.dispatcher.supervisor:Job PID: 596098 2024-04-17T09:21:37.823 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T09:23:37.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:25:38.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:27:38.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:29:38.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:31:38.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:33:38.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:35:38.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:37:39.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:39:39.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:39:39.245 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1