2024-03-26T18:22:32.429 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-26T18:22:32.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:22:32.604 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7faab075ef40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7faab16bfc10>, signals=[15])
2024-03-26T18:22:32.604 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2024-03-26T18:22:32.604 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T18:22:32.604 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-03-26T18:22:32.629 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging
2024-03-26T18:22:32.629 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T18:22:32.629 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2024-03-26T18:22:32.645 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2024-03-26T18:22:32.645 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T18:22:32.645 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2024-03-26T18:22:32.751 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_9.stream (ID 10)
2024-03-26T18:22:32.762 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10)
2024-03-26T18:22:32.766 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10)
2024-03-26T18:22:32.800 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 9.stream
2024-03-26T18:22:32.803 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream
2024-03-26T18:22:32.818 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream
2024-03-26T18:22:33.038 INFO:teuthology.orchestra.console.smithi066:Power off
2024-03-26T18:22:33.039 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T18:22:33.052 INFO:teuthology.orchestra.console.smithi098:Power off
2024-03-26T18:22:33.052 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T18:22:33.064 INFO:teuthology.orchestra.console.smithi026:Power off
2024-03-26T18:22:33.064 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T18:22:33.072 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2024-03-26T18:22:33.073 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:33.080 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2024-03-26T18:22:33.081 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:33.088 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2024-03-26T18:22:33.088 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:33.096 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-26T18:22:33.102 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2024-03-26T18:22:33.110 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-03-26T18:22:37.101 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:37.108 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:37.114 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:37.211 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-26T18:22:37.216 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2024-03-26T18:22:37.222 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-03-26T18:22:41.214 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:41.221 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:41.229 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:41.324 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-26T18:22:41.331 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2024-03-26T18:22:41.336 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-03-26T18:22:41.425 INFO:teuthology.orchestra.console.smithi066:Power off completed
2024-03-26T18:22:41.437 INFO:teuthology.orchestra.console.smithi026:Power off completed
2024-03-26T18:22:41.526 INFO:teuthology.orchestra.console.smithi066:Power on
2024-03-26T18:22:41.526 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T18:22:41.538 INFO:teuthology.orchestra.console.smithi026:Power on
2024-03-26T18:22:41.539 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T18:22:41.547 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On
2024-03-26T18:22:41.548 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:41.563 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On
2024-03-26T18:22:41.563 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:41.574 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-26T18:22:41.587 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-03-26T18:22:45.334 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:45.444 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2024-03-26T18:22:45.545 INFO:teuthology.orchestra.console.smithi098:Power off completed
2024-03-26T18:22:45.575 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:45.588 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:45.646 INFO:teuthology.orchestra.console.smithi098:Power on
2024-03-26T18:22:45.646 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T18:22:45.668 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On
2024-03-26T18:22:45.668 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:45.685 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-26T18:22:45.688 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2024-03-26T18:22:45.697 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-03-26T18:22:49.689 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:49.696 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:49.702 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T18:22:49.798 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-26T18:22:49.803 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2024-03-26T18:22:49.810 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-03-26T18:22:49.899 INFO:teuthology.orchestra.console.smithi066:Power on completed
2024-03-26T18:22:49.904 INFO:teuthology.orchestra.console.smithi098:Power on completed
2024-03-26T18:22:49.911 INFO:teuthology.orchestra.console.smithi026:Power on completed
2024-03-26T18:22:50.001 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2024-03-26T18:22:50.005 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2024-03-26T18:22:50.012 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2024-03-26T18:25:05.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:08.866 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-26T18:25:14.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:17.954 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-26T18:25:20.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:23.902 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-26T18:25:23.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:27.038 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-26T18:25:29.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:32.958 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-26T18:25:33.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:36.098 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-26T18:25:38.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:42.014 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-26T18:25:42.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:45.150 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-03-26T18:25:48.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:51.070 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-26T18:25:51.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:25:57.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:00.126 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-26T18:26:06.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:09.186 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-26T18:26:15.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:18.274 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-26T18:26:21.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:24.158 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:26:24.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:30.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:33.246 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:26:39.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:42.334 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:26:48.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:51.156 WARNING:teuthology.provision.fog.smithi026:timed out
2024-03-26T18:26:51.390 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:26:57.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:57.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:26:57.435 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T18:26:57.435 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T18:26:57.759 INFO:teuthology.provision.fog.smithi026:Node is ready
2024-03-26T18:26:57.759 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2024-03-26T18:26:57.774 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2024-03-26T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts
2024-03-26T18:26:57.830 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2024-03-26T18:26:57.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-03-26T18:26:57.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts
2024-03-26T18:26:57.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts
2024-03-26T18:26:58.045 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname
2024-03-26T18:26:58.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-03-26T18:26:58.186 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-03-26T18:26:58.241 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-03-26T18:26:58.241 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:26:58.242 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:26:58.243 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2024-03-26T18:26:58.245 DEBUG:teuthology.parallel:result is None
2024-03-26T18:27:00.446 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:27:06.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:27:09.502 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:27:15.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:27:18.558 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:27:24.282 WARNING:teuthology.provision.fog.smithi098:timed out
2024-03-26T18:27:24.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:27:27.614 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:27:30.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:27:30.614 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T18:27:30.614 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T18:27:30.932 INFO:teuthology.provision.fog.smithi098:Node is ready
2024-03-26T18:27:30.932 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2024-03-26T18:27:30.947 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2024-03-26T18:27:30.947 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts
2024-03-26T18:27:31.002 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2024-03-26T18:27:31.002 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2024-03-26T18:27:31.116 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts
2024-03-26T18:27:31.144 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts
2024-03-26T18:27:31.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname
2024-03-26T18:27:31.279 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2024-03-26T18:27:31.345 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2024-03-26T18:27:31.399 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2024-03-26T18:27:31.399 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9"
2024-03-26T18:27:31.399 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2024-03-26T18:27:31.399 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:27:31.399 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9"
2024-03-26T18:27:31.399 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:27:31.399 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:27:31.400 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2024-03-26T18:27:31.400 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:27:31.400 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:27:31.400 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:27:31.400 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:27:31.400 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:27:31.400 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:27:31.400 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2024-03-26T18:27:31.401 DEBUG:teuthology.parallel:result is None
2024-03-26T18:27:33.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:27:36.670 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:27:42.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:27:45.758 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:27:51.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:27:54.846 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-26T18:28:00.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:29:00.913 WARNING:teuthology.provision.fog.smithi066:timed out
2024-03-26T18:29:06.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:29:07.208 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T18:29:07.209 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T18:29:07.524 INFO:teuthology.provision.fog.smithi066:Node is ready
2024-03-26T18:29:07.525 DEBUG:teuthology.orchestra.run.smithi066:> hostname
2024-03-26T18:29:07.540 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2024-03-26T18:29:07.541 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts
2024-03-26T18:29:07.597 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2024-03-26T18:29:07.597 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2024-03-26T18:29:07.714 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts
2024-03-26T18:29:07.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts
2024-03-26T18:29:07.822 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname
2024-03-26T18:29:07.894 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2024-03-26T18:29:07.964 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2024-03-26T18:29:08.019 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:29:08.020 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:29:08.021 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:29:08.021 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2024-03-26T18:29:08.022 DEBUG:teuthology.parallel:result is None
2024-03-26T18:29:08.269 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2024-03-26T18:29:08.270 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T18:29:08.289 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2024-03-26T18:29:08.289 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T18:29:08.305 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2024-03-26T18:29:08.305 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T18:29:08.323 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2024-03-26T18:29:08.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-03-26T18:29:08.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:29:08.425 DEBUG:teuthology.orchestra.run.smithi026:> true
2024-03-26T18:29:08.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-03-26T18:29:08.609 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2024-03-26T18:29:08.664 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2024-03-26T18:29:08.665 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-03-26T18:29:08.719 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:29:08.720 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:29:08.720 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:29:08.720 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:29:08.720 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:29:08.720 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:29:08.720 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-03-26T18:29:08.739 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2024-03-26T18:29:08.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2024-03-26T18:29:08.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:29:08.838 DEBUG:teuthology.orchestra.run.smithi066:> true
2024-03-26T18:29:08.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com'
2024-03-26T18:29:08.905 DEBUG:teuthology.orchestra.run.smithi066:> uname -m
2024-03-26T18:29:08.960 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2024-03-26T18:29:08.960 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2024-03-26T18:29:09.015 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2024-03-26T18:29:09.015 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2024-03-26T18:29:09.015 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2024-03-26T18:29:09.015 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:29:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:29:09.016 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2024-03-26T18:29:09.039 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2024-03-26T18:29:09.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2024-03-26T18:29:09.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T18:29:09.126 DEBUG:teuthology.orchestra.run.smithi098:> true
2024-03-26T18:29:09.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2024-03-26T18:29:09.292 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2024-03-26T18:29:09.346 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2024-03-26T18:29:09.347 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2024-03-26T18:29:09.401 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T18:29:09.402 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-26T18:29:09.403 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-26T18:29:09.403 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2024-03-26T18:29:09.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:29:09.525 INFO:teuthology.dispatcher.supervisor:Running job 7623806
2024-03-26T18:29:09.525 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7623806 --name lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7623806/orig.config.yaml
2024-03-26T18:29:09.529 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-03-26_17:10:07-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7623806
2024-03-26T18:29:09.529 INFO:teuthology.dispatcher.supervisor:Job PID: 3127351
2024-03-26T18:29:09.529 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-26T18:31:09.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:33:09.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:35:09.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:37:10.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:39:10.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:41:10.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:43:10.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:45:10.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:47:10.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:49:11.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:51:11.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:53:11.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:55:11.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:57:11.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T18:57:11.785 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1