2024-03-14T15:23:53.455 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-14T15:23:53.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:23:53.605 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6eeb633f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6eec694c10>, signals=[15])
2024-03-14T15:23:53.605 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2024-03-14T15:23:53.606 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T15:23:53.606 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2024-03-14T15:23:53.623 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2024-03-14T15:23:53.623 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T15:23:53.623 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2024-03-14T15:23:53.648 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2024-03-14T15:23:53.648 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T15:23:53.648 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-03-14T15:23:53.740 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T15:23:53.781 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T15:23:53.784 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T15:23:53.794 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream
2024-03-14T15:23:53.838 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream
2024-03-14T15:23:53.842 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream
2024-03-14T15:23:54.252 INFO:teuthology.orchestra.console.smithi029:Power off
2024-03-14T15:23:54.252 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T15:23:54.273 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2024-03-14T15:23:54.274 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:54.295 INFO:teuthology.orchestra.console.smithi191:Power off
2024-03-14T15:23:54.295 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T15:23:54.303 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-03-14T15:23:54.324 INFO:teuthology.orchestra.console.smithi154:Power off
2024-03-14T15:23:54.324 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T15:23:54.332 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2024-03-14T15:23:54.332 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:54.345 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2024-03-14T15:23:54.346 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:54.353 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-03-14T15:23:54.368 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-03-14T15:23:54.405 INFO:teuthology.orchestra.console.smithi029:Power off completed
2024-03-14T15:23:54.454 INFO:teuthology.orchestra.console.smithi191:Power off completed
2024-03-14T15:23:54.469 INFO:teuthology.orchestra.console.smithi154:Power off completed
2024-03-14T15:23:54.506 INFO:teuthology.orchestra.console.smithi029:Power on
2024-03-14T15:23:54.506 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T15:23:54.528 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On
2024-03-14T15:23:54.528 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:54.552 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-03-14T15:23:54.555 INFO:teuthology.orchestra.console.smithi191:Power on
2024-03-14T15:23:54.555 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T15:23:54.570 INFO:teuthology.orchestra.console.smithi154:Power on
2024-03-14T15:23:54.570 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T15:23:54.578 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On
2024-03-14T15:23:54.579 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:54.590 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2024-03-14T15:23:54.591 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:54.599 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-03-14T15:23:54.612 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-03-14T15:23:58.556 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:58.600 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:58.613 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:23:58.666 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-03-14T15:23:58.708 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-03-14T15:23:58.721 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-03-14T15:24:02.671 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:24:02.708 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:24:02.722 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T15:24:02.779 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2024-03-14T15:24:02.817 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-03-14T15:24:02.829 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-03-14T15:24:02.880 INFO:teuthology.orchestra.console.smithi029:Power on completed
2024-03-14T15:24:02.918 INFO:teuthology.orchestra.console.smithi191:Power on completed
2024-03-14T15:24:02.930 INFO:teuthology.orchestra.console.smithi154:Power on completed
2024-03-14T15:24:02.982 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2024-03-14T15:24:03.019 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2024-03-14T15:24:03.031 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2024-03-14T15:27:05.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:27:23.935 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-03-14T15:27:29.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:27:32.990 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-03-14T15:27:38.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:27:42.046 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-03-14T15:27:48.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:27:51.134 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-03-14T15:27:57.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:51.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:28:51.154 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-14T15:28:57.144 WARNING:teuthology.provision.fog.smithi029:timed out
2024-03-14T15:29:03.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:29:03.436 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T15:29:03.437 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T15:29:03.816 INFO:teuthology.provision.fog.smithi029:Node is ready
2024-03-14T15:29:03.816 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2024-03-14T15:29:03.832 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2024-03-14T15:29:03.832 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2024-03-14T15:29:03.887 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2024-03-14T15:29:03.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2024-03-14T15:29:04.037 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2024-03-14T15:29:04.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2024-03-14T15:29:04.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2024-03-14T15:29:04.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2024-03-14T15:29:04.279 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:29:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:29:04.336 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2024-03-14T15:29:04.337 DEBUG:teuthology.parallel:result is None
2024-03-14T15:29:06.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:29:06.430 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-14T15:29:55.158 WARNING:teuthology.provision.fog.smithi154:timed out
2024-03-14T15:30:01.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:10.434 WARNING:teuthology.provision.fog.smithi191:timed out
2024-03-14T15:30:16.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:19.550 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-14T15:30:25.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:28.606 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-14T15:30:34.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:34.910 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-03-14T15:30:37.666 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-03-14T15:30:40.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:43.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:43.926 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T15:30:43.926 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T15:30:43.966 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-03-14T15:30:49.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:30:51.481 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T15:30:51.481 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T15:30:59.281 INFO:teuthology.provision.fog.smithi154:Node is ready
2024-03-14T15:30:59.282 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2024-03-14T15:30:59.300 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2024-03-14T15:30:59.300 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2024-03-14T15:30:59.358 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2024-03-14T15:30:59.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2024-03-14T15:30:59.459 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2024-03-14T15:30:59.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2024-03-14T15:30:59.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2024-03-14T15:30:59.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2024-03-14T15:30:59.695 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2024-03-14T15:30:59.750 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:30:59.751 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:30:59.752 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2024-03-14T15:30:59.753 DEBUG:teuthology.parallel:result is None
2024-03-14T15:31:11.813 INFO:teuthology.provision.fog.smithi191:Node is ready
2024-03-14T15:31:11.814 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2024-03-14T15:31:11.832 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2024-03-14T15:31:11.833 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts
2024-03-14T15:31:11.890 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2024-03-14T15:31:11.890 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-03-14T15:31:12.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts
2024-03-14T15:31:12.067 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2024-03-14T15:31:12.136 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname
2024-03-14T15:31:12.204 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-03-14T15:31:12.271 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-03-14T15:31:12.326 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-03-14T15:31:12.326 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9"
2024-03-14T15:31:12.326 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-03-14T15:31:12.326 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:31:12.326 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:31:12.327 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:31:12.327 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2024-03-14T15:31:12.328 DEBUG:teuthology.parallel:result is None
2024-03-14T15:31:12.569 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2024-03-14T15:31:12.569 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T15:31:12.591 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2024-03-14T15:31:12.591 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T15:31:12.606 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2024-03-14T15:31:12.607 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T15:31:12.625 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2024-03-14T15:31:12.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2024-03-14T15:31:12.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:31:12.730 DEBUG:teuthology.orchestra.run.smithi029:> true
2024-03-14T15:31:12.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2024-03-14T15:31:12.872 DEBUG:teuthology.orchestra.run.smithi029:> uname -m
2024-03-14T15:31:12.926 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2024-03-14T15:31:12.927 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2024-03-14T15:31:12.981 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:31:12.982 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:31:12.983 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:31:12.983 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:31:12.983 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2024-03-14T15:31:13.007 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2024-03-14T15:31:13.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2024-03-14T15:31:13.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:31:13.094 DEBUG:teuthology.orchestra.run.smithi154:> true
2024-03-14T15:31:13.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com'
2024-03-14T15:31:13.268 DEBUG:teuthology.orchestra.run.smithi154:> uname -m
2024-03-14T15:31:13.327 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2024-03-14T15:31:13.327 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2024-03-14T15:31:13.385 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2024-03-14T15:31:13.385 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9"
2024-03-14T15:31:13.385 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2024-03-14T15:31:13.385 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:31:13.385 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9"
2024-03-14T15:31:13.385 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:31:13.385 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:31:13.385 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2024-03-14T15:31:13.386 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:31:13.386 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:31:13.386 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:31:13.386 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:31:13.386 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:31:13.386 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:31:13.386 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2024-03-14T15:31:13.415 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2024-03-14T15:31:13.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-03-14T15:31:13.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T15:31:13.504 DEBUG:teuthology.orchestra.run.smithi191:> true
2024-03-14T15:31:13.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-03-14T15:31:13.574 DEBUG:teuthology.orchestra.run.smithi191:> uname -m
2024-03-14T15:31:13.629 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2024-03-14T15:31:13.630 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-03-14T15:31:13.684 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-03-14T15:31:13.684 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9"
2024-03-14T15:31:13.684 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-03-14T15:31:13.684 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-03-14T15:31:13.684 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T15:31:13.685 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T15:31:13.685 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-03-14T15:31:13.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:31:13.808 INFO:teuthology.dispatcher.supervisor:Running job 7600202
2024-03-14T15:31:13.808 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600202 --name pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600202/orig.config.yaml
2024-03-14T15:31:13.811 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-14_15:20:35-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7600202
2024-03-14T15:31:13.811 INFO:teuthology.dispatcher.supervisor:Job PID: 1255722
2024-03-14T15:31:13.811 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-14T15:33:13.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:35:13.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:37:13.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:39:14.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:41:14.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:43:14.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:45:14.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:47:14.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:49:14.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:51:14.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:53:14.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:55:14.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:57:14.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T15:59:14.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:01:14.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:03:14.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:05:14.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:07:15.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:09:15.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:11:15.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:13:15.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:15:15.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:17:15.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:19:15.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:21:15.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:23:15.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:25:15.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:27:15.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:29:15.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:31:15.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:33:15.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:35:16.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:37:16.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:39:16.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T16:39:16.273 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1