2024-03-31T15:43:35.443 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-31T15:43:35.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T15:43:35.623 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1152001f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1153062c10>, signals=[15])
2024-03-31T15:43:35.623 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging
2024-03-31T15:43:35.623 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server
2024-03-31T15:43:35.623 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2024-03-31T15:43:35.643 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2024-03-31T15:43:35.643 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2024-03-31T15:43:35.643 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-03-31T15:43:35.668 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2024-03-31T15:43:35.668 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2024-03-31T15:43:35.668 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-03-31T15:43:35.764 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10)
2024-03-31T15:43:35.778 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10)
2024-03-31T15:43:35.800 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10)
2024-03-31T15:43:35.809 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream
2024-03-31T15:43:35.820 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream
2024-03-31T15:43:35.848 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream
2024-03-31T15:43:36.026 INFO:teuthology.orchestra.console.smithi105:Power off
2024-03-31T15:43:36.026 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-31T15:43:36.040 INFO:teuthology.orchestra.console.smithi064:Power off
2024-03-31T15:43:36.040 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-31T15:43:36.057 INFO:teuthology.orchestra.console.smithi111:Power off
2024-03-31T15:43:36.057 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-31T15:43:36.065 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off
2024-03-31T15:43:36.065 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:36.075 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off
2024-03-31T15:43:36.076 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:36.085 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2024-03-31T15:43:36.085 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:36.093 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-31T15:43:36.098 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2024-03-31T15:43:36.106 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-31T15:43:40.098 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:40.105 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:40.113 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:40.208 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-31T15:43:40.214 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2024-03-31T15:43:40.223 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-31T15:43:44.210 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:44.218 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:44.226 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:44.320 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-31T15:43:44.327 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2024-03-31T15:43:44.336 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-31T15:43:44.430 INFO:teuthology.orchestra.console.smithi064:Power off completed
2024-03-31T15:43:44.437 INFO:teuthology.orchestra.console.smithi111:Power off completed
2024-03-31T15:43:44.530 INFO:teuthology.orchestra.console.smithi064:Power on
2024-03-31T15:43:44.531 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-31T15:43:44.540 INFO:teuthology.orchestra.console.smithi111:Power on
2024-03-31T15:43:44.540 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-31T15:43:44.555 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On
2024-03-31T15:43:44.556 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:44.564 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2024-03-31T15:43:44.565 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:44.579 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2024-03-31T15:43:44.586 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-31T15:43:48.324 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:48.433 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-31T15:43:48.533 INFO:teuthology.orchestra.console.smithi105:Power off completed
2024-03-31T15:43:48.580 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:48.588 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:48.634 INFO:teuthology.orchestra.console.smithi105:Power on
2024-03-31T15:43:48.635 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-31T15:43:48.662 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On
2024-03-31T15:43:48.663 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:48.690 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2024-03-31T15:43:48.693 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off
2024-03-31T15:43:48.696 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-31T15:43:52.694 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:52.703 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:52.712 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T15:43:52.806 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2024-03-31T15:43:52.814 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on
2024-03-31T15:43:52.822 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-31T15:43:52.908 INFO:teuthology.orchestra.console.smithi064:Power on completed
2024-03-31T15:43:52.915 INFO:teuthology.orchestra.console.smithi105:Power on completed
2024-03-31T15:43:52.923 INFO:teuthology.orchestra.console.smithi111:Power on completed
2024-03-31T15:43:53.009 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2024-03-31T15:43:53.016 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2024-03-31T15:43:53.025 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2024-03-31T15:46:23.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:46:23.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:46:24.147 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-31T15:46:26.910 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-03-31T15:46:32.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:46:35.966 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-03-31T15:46:38.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:46:41.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:46:41.986 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-31T15:46:45.022 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-03-31T15:46:47.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:46:51.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:46:51.038 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-31T15:46:54.078 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-03-31T15:46:57.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:00.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:00.094 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-31T15:47:03.134 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-03-31T15:47:06.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:09.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:09.150 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-31T15:47:12.190 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2024-03-31T15:47:15.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:18.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:18.206 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-31T15:47:24.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:27.262 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-31T15:47:28.150 WARNING:teuthology.provision.fog.smithi105:timed out
2024-03-31T15:47:33.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:34.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:36.318 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-31T15:47:42.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:45.378 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-31T15:47:51.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:47:52.478 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-31T15:47:58.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:48:01.538 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2024-03-31T15:48:07.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:48:07.801 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-31T15:48:07.801 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-31T15:48:18.194 WARNING:teuthology.provision.fog.smithi064:timed out
2024-03-31T15:48:24.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:48:24.446 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-31T15:48:24.446 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-31T15:48:24.774 INFO:teuthology.provision.fog.smithi064:Node is ready
2024-03-31T15:48:24.774 DEBUG:teuthology.orchestra.run.smithi064:> hostname
2024-03-31T15:48:24.789 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com
2024-03-31T15:48:24.789 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts
2024-03-31T15:48:24.845 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064
2024-03-31T15:48:24.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2024-03-31T15:48:24.962 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts
2024-03-31T15:48:24.994 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts
2024-03-31T15:48:25.064 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname
2024-03-31T15:48:25.135 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2024-03-31T15:48:25.205 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2024-03-31T15:48:25.259 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T15:48:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T15:48:25.261 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2024-03-31T15:48:25.266 DEBUG:teuthology.parallel:result is None
2024-03-31T15:48:28.113 INFO:teuthology.provision.fog.smithi105:Node is ready
2024-03-31T15:48:28.113 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2024-03-31T15:48:28.131 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2024-03-31T15:48:28.131 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2024-03-31T15:48:28.189 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2024-03-31T15:48:28.189 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-03-31T15:48:28.315 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2024-03-31T15:48:28.345 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2024-03-31T15:48:28.414 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2024-03-31T15:48:28.482 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2024-03-31T15:48:28.549 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-03-31T15:48:28.604 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2024-03-31T15:48:28.604 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9"
2024-03-31T15:48:28.604 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2024-03-31T15:48:28.604 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2024-03-31T15:48:28.604 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9"
2024-03-31T15:48:28.604 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9"
2024-03-31T15:48:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T15:48:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2024-03-31T15:48:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon"
2024-03-31T15:48:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T15:48:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2024-03-31T15:48:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T15:48:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T15:48:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T15:48:28.605 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2024-03-31T15:48:28.606 DEBUG:teuthology.parallel:result is None
2024-03-31T15:48:51.382 WARNING:teuthology.provision.fog.smithi111:timed out
2024-03-31T15:48:57.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:48:57.691 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-31T15:48:57.691 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-31T15:48:58.018 INFO:teuthology.provision.fog.smithi111:Node is ready
2024-03-31T15:48:58.018 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2024-03-31T15:48:58.033 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2024-03-31T15:48:58.034 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2024-03-31T15:48:58.089 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2024-03-31T15:48:58.089 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-03-31T15:48:58.190 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2024-03-31T15:48:58.218 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2024-03-31T15:48:58.285 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2024-03-31T15:48:58.353 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-03-31T15:48:58.420 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-03-31T15:48:58.474 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-03-31T15:48:58.474 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-03-31T15:48:58.474 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-03-31T15:48:58.474 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-03-31T15:48:58.474 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T15:48:58.475 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T15:48:58.475 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2024-03-31T15:48:58.476 DEBUG:teuthology.parallel:result is None
2024-03-31T15:48:58.736 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com
2024-03-31T15:48:58.736 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-31T15:48:58.756 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2024-03-31T15:48:58.756 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-31T15:48:58.780 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2024-03-31T15:48:58.780 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-31T15:48:58.806 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server
2024-03-31T15:48:58.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com'
2024-03-31T15:48:58.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:48:58.909 DEBUG:teuthology.orchestra.run.smithi064:> true
2024-03-31T15:48:59.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com'
2024-03-31T15:48:59.093 DEBUG:teuthology.orchestra.run.smithi064:> uname -m
2024-03-31T15:48:59.148 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64
2024-03-31T15:48:59.148 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2024-03-31T15:48:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream"
2024-03-31T15:48:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9"
2024-03-31T15:48:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2024-03-31T15:48:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2024-03-31T15:48:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9"
2024-03-31T15:48:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9"
2024-03-31T15:48:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T15:48:59.204 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2024-03-31T15:48:59.205 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon"
2024-03-31T15:48:59.205 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T15:48:59.205 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2024-03-31T15:48:59.205 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T15:48:59.205 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T15:48:59.205 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T15:48:59.205 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2024-03-31T15:48:59.231 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2024-03-31T15:48:59.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-03-31T15:48:59.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:48:59.319 DEBUG:teuthology.orchestra.run.smithi105:> true
2024-03-31T15:48:59.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2024-03-31T15:48:59.488 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2024-03-31T15:48:59.543 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2024-03-31T15:48:59.543 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2024-03-31T15:48:59.597 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2024-03-31T15:48:59.597 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9"
2024-03-31T15:48:59.597 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2024-03-31T15:48:59.597 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2024-03-31T15:48:59.597 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9"
2024-03-31T15:48:59.597 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9"
2024-03-31T15:48:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T15:48:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2024-03-31T15:48:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon"
2024-03-31T15:48:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T15:48:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2024-03-31T15:48:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T15:48:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T15:48:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T15:48:59.598 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2024-03-31T15:48:59.622 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2024-03-31T15:48:59.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-03-31T15:48:59.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-31T15:48:59.710 DEBUG:teuthology.orchestra.run.smithi111:> true
2024-03-31T15:48:59.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-03-31T15:48:59.778 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2024-03-31T15:48:59.833 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2024-03-31T15:48:59.834 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-03-31T15:48:59.889 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-03-31T15:48:59.889 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-31T15:48:59.890 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-31T15:48:59.891 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-03-31T15:48:59.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T15:49:00.012 INFO:teuthology.dispatcher.supervisor:Running job 7631672
2024-03-31T15:49:00.012 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631672 --name vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631672/orig.config.yaml
2024-03-31T15:49:00.016 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631672
2024-03-31T15:49:00.016 INFO:teuthology.dispatcher.supervisor:Job PID: 108915
2024-03-31T15:49:00.016 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-31T15:51:00.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T15:53:00.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T15:55:00.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T15:57:00.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T15:59:00.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T16:01:00.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T16:01:00.443 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1