2024-03-14T15:23:51.098 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-14T15:23:51.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:23:51.270 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f49345edf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4935661c10>, signals=[15])
2024-03-14T15:23:51.271 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2024-03-14T15:23:51.271 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T15:23:51.271 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-03-14T15:23:51.296 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging
2024-03-14T15:23:51.297 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T15:23:51.297 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2024-03-14T15:23:51.321 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging
2024-03-14T15:23:51.322 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T15:23:51.322 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2024-03-14T15:23:51.401 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T15:23:51.423 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T15:23:51.447 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T15:23:51.459 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 9.stream
2024-03-14T15:23:51.469 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of centos 9.stream
2024-03-14T15:23:51.505 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 9.stream
2024-03-14T15:23:51.881 INFO:teuthology.orchestra.console.smithi134:Power off
2024-03-14T15:23:51.881 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T15:23:51.896 INFO:teuthology.orchestra.console.smithi082:Power off
2024-03-14T15:23:51.897 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T15:23:51.909 INFO:teuthology.orchestra.console.smithi032:Power off
2024-03-14T15:23:51.910 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T15:23:51.917 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off
2024-03-14T15:23:51.917 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:51.926 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off
2024-03-14T15:23:51.926 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:51.935 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2024-03-14T15:23:51.936 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:51.944 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-03-14T15:23:51.948 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off
2024-03-14T15:23:51.956 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-14T15:23:52.045 INFO:teuthology.orchestra.console.smithi134:Power off completed
2024-03-14T15:23:52.050 INFO:teuthology.orchestra.console.smithi082:Power off completed
2024-03-14T15:23:52.057 INFO:teuthology.orchestra.console.smithi032:Power off completed
2024-03-14T15:23:52.146 INFO:teuthology.orchestra.console.smithi134:Power on
2024-03-14T15:23:52.147 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T15:23:52.154 INFO:teuthology.orchestra.console.smithi082:Power on
2024-03-14T15:23:52.155 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T15:23:52.162 INFO:teuthology.orchestra.console.smithi032:Power on
2024-03-14T15:23:52.163 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T15:23:52.171 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On
2024-03-14T15:23:52.171 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:52.179 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On
2024-03-14T15:23:52.179 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:52.188 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On
2024-03-14T15:23:52.188 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:52.197 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-03-14T15:23:52.201 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off
2024-03-14T15:23:52.211 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-14T15:23:56.198 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:56.205 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:56.211 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:56.307 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2024-03-14T15:23:56.312 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on
2024-03-14T15:23:56.319 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-14T15:23:56.408 INFO:teuthology.orchestra.console.smithi134:Power on completed
2024-03-14T15:23:56.412 INFO:teuthology.orchestra.console.smithi082:Power on completed
2024-03-14T15:23:56.509 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2024-03-14T15:23:56.513 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish
2024-03-14T15:24:00.324 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:24:00.433 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-14T15:24:00.533 INFO:teuthology.orchestra.console.smithi032:Power on completed
2024-03-14T15:24:00.634 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2024-03-14T15:26:17.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:26:35.806 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-14T15:26:41.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:26:44.894 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-14T15:26:50.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:26:53.982 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-14T15:26:59.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:27:29.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:27:47.487 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82
2024-03-14T15:27:53.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:27:56.574 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82
2024-03-14T15:27:59.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:27:59.988 WARNING:teuthology.provision.fog.smithi032:timed out
2024-03-14T15:28:02.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:05.630 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82
2024-03-14T15:28:05.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:06.279 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T15:28:06.279 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T15:28:06.616 INFO:teuthology.provision.fog.smithi032:Node is ready
2024-03-14T15:28:06.616 DEBUG:teuthology.orchestra.run.smithi032:> hostname
2024-03-14T15:28:06.631 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2024-03-14T15:28:06.631 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts
2024-03-14T15:28:06.686 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2024-03-14T15:28:06.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-03-14T15:28:06.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts
2024-03-14T15:28:06.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts
2024-03-14T15:28:06.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname
2024-03-14T15:28:06.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-03-14T15:28:07.047 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-03-14T15:28:07.101 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2024-03-14T15:28:07.101 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9"
2024-03-14T15:28:07.101 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2024-03-14T15:28:07.101 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:28:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:28:07.103 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2024-03-14T15:28:07.104 DEBUG:teuthology.parallel:result is None
2024-03-14T15:28:11.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:14.687 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82
2024-03-14T15:28:17.694 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-14T15:28:20.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:23.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:23.742 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82
2024-03-14T15:28:26.750 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-14T15:28:29.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:32.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:35.806 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-14T15:28:41.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:44.898 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-14T15:28:50.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:53.982 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-14T15:28:59.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:29:18.366 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-14T15:29:24.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:29:27.423 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-14T15:29:29.750 WARNING:teuthology.provision.fog.smithi082:timed out
2024-03-14T15:29:33.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:29:35.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:29:36.059 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T15:29:36.059 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T15:29:36.380 INFO:teuthology.provision.fog.smithi082:Node is ready
2024-03-14T15:29:36.380 DEBUG:teuthology.orchestra.run.smithi082:> hostname
2024-03-14T15:29:36.395 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com
2024-03-14T15:29:36.395 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi082.front.sepia.ceph.com /etc/hosts
2024-03-14T15:29:36.450 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082
2024-03-14T15:29:36.450 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082
2024-03-14T15:29:36.478 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-14T15:29:36.565 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hosts
2024-03-14T15:29:36.592 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.82/172.21.15.82/g' /etc/hosts
2024-03-14T15:29:36.659 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hostname
2024-03-14T15:29:36.726 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082
2024-03-14T15:29:36.792 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release
2024-03-14T15:29:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream"
2024-03-14T15:29:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9"
2024-03-14T15:29:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos"
2024-03-14T15:29:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:29:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9"
2024-03-14T15:29:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:29:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:29:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31"
2024-03-14T15:29:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:29:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:29:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:29:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:29:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:29:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:29:36.848 INFO:teuthology.provision.fog.smithi082:Deploy complete!
2024-03-14T15:29:36.848 DEBUG:teuthology.parallel:result is None
2024-03-14T15:29:42.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:29:42.759 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T15:29:42.759 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T15:30:03.204 INFO:teuthology.provision.fog.smithi134:Node is ready
2024-03-14T15:30:03.205 DEBUG:teuthology.orchestra.run.smithi134:> hostname
2024-03-14T15:30:03.223 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2024-03-14T15:30:03.223 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts
2024-03-14T15:30:03.280 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2024-03-14T15:30:03.281 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2024-03-14T15:30:03.431 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts
2024-03-14T15:30:03.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts
2024-03-14T15:30:03.529 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname
2024-03-14T15:30:03.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2024-03-14T15:30:03.663 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:30:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:30:03.719 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:30:03.719 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2024-03-14T15:30:03.719 DEBUG:teuthology.parallel:result is None
2024-03-14T15:30:03.926 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2024-03-14T15:30:03.927 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T15:30:03.953 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com
2024-03-14T15:30:03.953 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T15:30:03.970 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2024-03-14T15:30:03.970 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T15:30:03.987 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2024-03-14T15:30:03.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-03-14T15:30:03.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:04.092 DEBUG:teuthology.orchestra.run.smithi032:> true
2024-03-14T15:30:04.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-03-14T15:30:04.277 DEBUG:teuthology.orchestra.run.smithi032:> uname -m
2024-03-14T15:30:04.331 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2024-03-14T15:30:04.331 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-03-14T15:30:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2024-03-14T15:30:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9"
2024-03-14T15:30:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2024-03-14T15:30:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:30:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9"
2024-03-14T15:30:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:30:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:30:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-03-14T15:30:04.387 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:30:04.387 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:30:04.387 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:30:04.387 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:30:04.387 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:30:04.387 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:30:04.387 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-03-14T15:30:04.411 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server
2024-03-14T15:30:04.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com'
2024-03-14T15:30:04.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:04.498 DEBUG:teuthology.orchestra.run.smithi082:> true
2024-03-14T15:30:04.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com'
2024-03-14T15:30:04.668 DEBUG:teuthology.orchestra.run.smithi082:> uname -m
2024-03-14T15:30:04.722 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64
2024-03-14T15:30:04.723 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release
2024-03-14T15:30:04.777 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:30:04.778 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:30:04.779 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:30:04.779 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:30:04.779 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2024-03-14T15:30:04.803 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2024-03-14T15:30:04.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2024-03-14T15:30:04.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:04.892 DEBUG:teuthology.orchestra.run.smithi134:> true
2024-03-14T15:30:04.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com'
2024-03-14T15:30:04.962 DEBUG:teuthology.orchestra.run.smithi134:> uname -m
2024-03-14T15:30:05.018 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2024-03-14T15:30:05.018 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9"
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9"
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2024-03-14T15:30:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:30:05.075 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:30:05.075 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:30:05.075 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:30:05.075 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:30:05.075 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:30:05.075 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2024-03-14T15:30:05.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:30:05.217 INFO:teuthology.dispatcher.supervisor:Running job 7600196
2024-03-14T15:30:05.217 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600196 --name pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600196/orig.config.yaml
2024-03-14T15:30:05.220 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600196
2024-03-14T15:30:05.220 INFO:teuthology.dispatcher.supervisor:Job PID: 1253335
2024-03-14T15:30:05.220 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-14T15:32:05.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:34:05.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:36:05.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:38:05.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:40:06.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:42:06.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:44:06.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:46:06.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:48:06.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:50:06.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:52:06.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:54:07.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:56:07.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:58:07.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:00:07.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:00:07.673 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1