2024-03-11T13:43:02.520 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-11T13:43:02.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T13:43:02.696 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f57c9edff40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f57cae80c10>, signals=[15])
2024-03-11T13:43:02.697 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging
2024-03-11T13:43:02.697 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T13:43:02.698 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2024-03-11T13:43:02.724 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging
2024-03-11T13:43:02.724 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T13:43:02.724 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2024-03-11T13:43:02.749 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2024-03-11T13:43:02.749 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T13:43:02.749 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-03-11T13:43:02.849 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T13:43:02.874 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T13:43:02.884 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T13:43:02.893 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 9.stream
2024-03-11T13:43:02.934 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 9.stream
2024-03-11T13:43:02.941 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream
2024-03-11T13:43:03.164 INFO:teuthology.orchestra.console.smithi033:Power off
2024-03-11T13:43:03.164 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T13:43:03.189 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off
2024-03-11T13:43:03.189 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:03.214 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2024-03-11T13:43:03.232 INFO:teuthology.orchestra.console.smithi111:Power off
2024-03-11T13:43:03.233 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T13:43:03.249 INFO:teuthology.orchestra.console.smithi083:Power off
2024-03-11T13:43:03.250 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T13:43:03.259 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2024-03-11T13:43:03.259 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:03.277 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off
2024-03-11T13:43:03.278 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:03.289 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-11T13:43:03.305 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-03-11T13:43:07.219 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:07.291 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:07.306 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:07.329 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2024-03-11T13:43:07.401 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-11T13:43:07.416 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-03-11T13:43:11.334 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:11.402 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:11.417 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:11.447 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2024-03-11T13:43:11.512 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-11T13:43:11.527 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-03-11T13:43:11.548 INFO:teuthology.orchestra.console.smithi033:Power off completed
2024-03-11T13:43:11.628 INFO:teuthology.orchestra.console.smithi083:Power off completed
2024-03-11T13:43:11.649 INFO:teuthology.orchestra.console.smithi033:Power on
2024-03-11T13:43:11.649 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T13:43:11.672 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On
2024-03-11T13:43:11.672 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:11.700 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2024-03-11T13:43:11.728 INFO:teuthology.orchestra.console.smithi083:Power on
2024-03-11T13:43:11.728 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T13:43:11.750 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On
2024-03-11T13:43:11.751 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:11.775 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-03-11T13:43:15.514 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:15.625 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-11T13:43:15.700 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:15.726 INFO:teuthology.orchestra.console.smithi111:Power off completed
2024-03-11T13:43:15.776 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:15.810 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2024-03-11T13:43:15.826 INFO:teuthology.orchestra.console.smithi111:Power on
2024-03-11T13:43:15.827 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T13:43:15.850 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2024-03-11T13:43:15.850 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:15.871 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-11T13:43:15.889 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-03-11T13:43:19.815 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:19.873 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:19.890 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:19.924 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2024-03-11T13:43:19.982 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-11T13:43:19.999 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-03-11T13:43:20.026 INFO:teuthology.orchestra.console.smithi033:Power on completed
2024-03-11T13:43:20.100 INFO:teuthology.orchestra.console.smithi083:Power on completed
2024-03-11T13:43:20.127 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2024-03-11T13:43:20.201 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish
2024-03-11T13:43:23.986 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T13:43:24.096 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-11T13:43:24.196 INFO:teuthology.orchestra.console.smithi111:Power on completed
2024-03-11T13:43:24.297 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2024-03-11T13:45:35.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:45:38.943 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-03-11T13:45:44.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:45:48.034 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-03-11T13:45:50.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:45:54.014 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-11T13:45:54.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:45:57.086 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-03-11T13:46:00.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:03.070 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-11T13:46:03.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:06.142 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-03-11T13:46:09.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:10.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:12.126 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-11T13:46:12.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:13.218 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:46:15.198 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-03-11T13:46:18.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:19.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:21.182 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-11T13:46:21.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:22.274 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:46:27.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:28.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:30.242 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-11T13:46:31.358 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:46:36.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:37.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:39.326 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-03-11T13:46:40.414 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:46:45.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:46.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:49.470 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:46:55.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:46:58.526 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:47:04.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:47:07.582 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:47:13.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:47:16.638 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:47:21.207 WARNING:teuthology.provision.fog.smithi033:timed out
2024-03-11T13:47:22.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:47:25.694 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T13:47:27.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:47:27.497 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T13:47:27.497 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T13:47:27.844 INFO:teuthology.provision.fog.smithi033:Node is ready
2024-03-11T13:47:27.845 DEBUG:teuthology.orchestra.run.smithi033:> hostname
2024-03-11T13:47:27.860 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com
2024-03-11T13:47:27.860 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts
2024-03-11T13:47:27.915 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033
2024-03-11T13:47:27.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2024-03-11T13:47:28.031 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts
2024-03-11T13:47:28.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts
2024-03-11T13:47:28.134 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname
2024-03-11T13:47:28.204 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2024-03-11T13:47:28.274 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream"
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9"
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos"
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora"
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9"
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9"
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2024-03-11T13:47:28.330 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon"
2024-03-11T13:47:28.331 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T13:47:28.331 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/"
2024-03-11T13:47:28.331 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T13:47:28.331 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T13:47:28.331 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T13:47:28.331 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2024-03-11T13:47:28.333 DEBUG:teuthology.parallel:result is None
2024-03-11T13:47:31.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:47:45.343 WARNING:teuthology.provision.fog.smithi083:timed out
2024-03-11T13:47:51.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:47:51.599 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T13:47:51.599 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T13:47:51.900 INFO:teuthology.provision.fog.smithi083:Node is ready
2024-03-11T13:47:51.900 DEBUG:teuthology.orchestra.run.smithi083:> hostname
2024-03-11T13:47:51.915 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com
2024-03-11T13:47:51.915 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts
2024-03-11T13:47:51.971 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083
2024-03-11T13:47:51.971 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2024-03-11T13:47:52.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts
2024-03-11T13:47:52.113 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts
2024-03-11T13:47:52.179 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname
2024-03-11T13:47:52.247 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2024-03-11T13:47:52.313 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2024-03-11T13:47:52.367 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream"
2024-03-11T13:47:52.367 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T13:47:52.368 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T13:47:52.368 INFO:teuthology.provision.fog.smithi083:Deploy complete!
2024-03-11T13:47:52.369 DEBUG:teuthology.parallel:result is None
2024-03-11T13:48:31.739 WARNING:teuthology.provision.fog.smithi111:timed out
2024-03-11T13:48:37.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:48:38.137 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T13:48:38.137 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T13:48:38.471 INFO:teuthology.provision.fog.smithi111:Node is ready
2024-03-11T13:48:38.471 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2024-03-11T13:48:38.485 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2024-03-11T13:48:38.486 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2024-03-11T13:48:38.544 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2024-03-11T13:48:38.544 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-03-11T13:48:38.651 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2024-03-11T13:48:38.678 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2024-03-11T13:48:38.748 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2024-03-11T13:48:38.818 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-03-11T13:48:38.888 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-03-11T13:48:38.946 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-03-11T13:48:38.947 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T13:48:38.948 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T13:48:38.948 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T13:48:38.948 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2024-03-11T13:48:38.948 DEBUG:teuthology.parallel:result is None
2024-03-11T13:48:39.163 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2024-03-11T13:48:39.164 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T13:48:39.185 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com
2024-03-11T13:48:39.185 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T13:48:39.209 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2024-03-11T13:48:39.209 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T13:48:39.227 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2024-03-11T13:48:39.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2024-03-11T13:48:39.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:48:39.334 DEBUG:teuthology.orchestra.run.smithi033:> true
2024-03-11T13:48:39.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com'
2024-03-11T13:48:39.517 DEBUG:teuthology.orchestra.run.smithi033:> uname -m
2024-03-11T13:48:39.571 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2024-03-11T13:48:39.572 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2024-03-11T13:48:39.626 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream"
2024-03-11T13:48:39.626 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T13:48:39.627 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T13:48:39.628 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2024-03-11T13:48:39.651 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server
2024-03-11T13:48:39.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2024-03-11T13:48:39.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:48:39.742 DEBUG:teuthology.orchestra.run.smithi083:> true
2024-03-11T13:48:39.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com'
2024-03-11T13:48:39.909 DEBUG:teuthology.orchestra.run.smithi083:> uname -m
2024-03-11T13:48:39.963 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64
2024-03-11T13:48:39.964 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2024-03-11T13:48:40.018 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream"
2024-03-11T13:48:40.018 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9"
2024-03-11T13:48:40.018 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos"
2024-03-11T13:48:40.018 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T13:48:40.019 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T13:48:40.020 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2024-03-11T13:48:40.043 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2024-03-11T13:48:40.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-03-11T13:48:40.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T13:48:40.133 DEBUG:teuthology.orchestra.run.smithi111:> true
2024-03-11T13:48:40.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-03-11T13:48:40.203 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2024-03-11T13:48:40.263 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2024-03-11T13:48:40.263 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-03-11T13:48:40.320 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T13:48:40.321 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T13:48:40.322 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T13:48:40.322 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-03-11T13:48:40.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T13:48:40.471 INFO:teuthology.dispatcher.supervisor:Running job 7591002
2024-03-11T13:48:40.472 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591002 --name teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/pjd}} -- /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591002/orig.config.yaml
2024-03-11T13:48:40.474 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591002
2024-03-11T13:48:40.475 INFO:teuthology.dispatcher.supervisor:Job PID: 1513406
2024-03-11T13:48:40.475 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-11T13:50:40.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T13:52:40.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T13:54:40.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T13:56:41.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T13:58:41.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:00:41.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:02:41.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:04:41.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:06:41.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:08:42.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:10:42.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:12:42.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:14:42.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:16:42.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:18:42.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:20:43.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:22:43.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:24:43.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:26:43.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:28:43.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:30:43.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T14:30:44.048 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1