2024-03-18T15:33:19.576 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-18T15:33:19.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:33:19.745 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb3f4e60f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb3f5ec1c10>, signals=[15])
2024-03-18T15:33:19.745 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging
2024-03-18T15:33:19.746 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server
2024-03-18T15:33:19.746 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2024-03-18T15:33:19.769 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging
2024-03-18T15:33:19.769 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server
2024-03-18T15:33:19.769 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-03-18T15:33:19.793 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2024-03-18T15:33:19.794 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2024-03-18T15:33:19.794 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2024-03-18T15:33:19.885 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_8.stream (ID 3)
2024-03-18T15:33:19.910 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_8.stream (ID 3)
2024-03-18T15:33:19.924 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3)
2024-03-18T15:33:19.929 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream
2024-03-18T15:33:19.965 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream
2024-03-18T15:33:19.974 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream
2024-03-18T15:33:20.261 INFO:teuthology.orchestra.console.smithi023:Power off
2024-03-18T15:33:20.261 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-18T15:33:20.277 INFO:teuthology.orchestra.console.smithi165:Power off
2024-03-18T15:33:20.277 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-18T15:33:20.292 INFO:teuthology.orchestra.console.smithi169:Power off
2024-03-18T15:33:20.292 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-18T15:33:20.299 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off
2024-03-18T15:33:20.300 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:20.308 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off
2024-03-18T15:33:20.308 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:20.316 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2024-03-18T15:33:20.316 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:20.325 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-18T15:33:20.328 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2024-03-18T15:33:20.337 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-03-18T15:33:20.426 INFO:teuthology.orchestra.console.smithi165:Power off completed
2024-03-18T15:33:20.429 INFO:teuthology.orchestra.console.smithi023:Power off completed
2024-03-18T15:33:20.439 INFO:teuthology.orchestra.console.smithi169:Power off completed
2024-03-18T15:33:20.527 INFO:teuthology.orchestra.console.smithi165:Power on
2024-03-18T15:33:20.527 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-18T15:33:20.535 INFO:teuthology.orchestra.console.smithi023:Power on
2024-03-18T15:33:20.535 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-18T15:33:20.542 INFO:teuthology.orchestra.console.smithi169:Power on
2024-03-18T15:33:20.546 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-18T15:33:20.557 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On
2024-03-18T15:33:20.558 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:20.567 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On
2024-03-18T15:33:20.567 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:20.576 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On
2024-03-18T15:33:20.577 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:20.585 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-18T15:33:20.589 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2024-03-18T15:33:20.597 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-03-18T15:33:24.586 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:24.594 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:24.601 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:24.697 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-18T15:33:24.702 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2024-03-18T15:33:24.709 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-03-18T15:33:24.798 INFO:teuthology.orchestra.console.smithi165:Power on completed
2024-03-18T15:33:24.898 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2024-03-18T15:33:28.707 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:28.714 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-18T15:33:28.816 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on
2024-03-18T15:33:28.822 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2024-03-18T15:33:28.918 INFO:teuthology.orchestra.console.smithi023:Power on completed
2024-03-18T15:33:28.923 INFO:teuthology.orchestra.console.smithi169:Power on completed
2024-03-18T15:33:29.019 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2024-03-18T15:33:29.025 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2024-03-18T15:36:15.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:18.178 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-18T15:36:24.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:26.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:27.262 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-18T15:36:29.154 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-18T15:36:30.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:33.250 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:36:33.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:35.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:36.318 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-18T15:36:38.242 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-18T15:36:39.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:42.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:42.334 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:36:44.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:45.374 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-18T15:36:47.326 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-18T15:36:48.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:51.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:51.394 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:36:53.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:36:54.430 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-18T15:36:56.382 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-18T15:36:57.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:00.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:00.446 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:37:02.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:03.486 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-18T15:37:05.438 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-18T15:37:06.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:09.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:09.502 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:37:11.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:12.542 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-18T15:37:14.498 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-18T15:37:15.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:18.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:18.562 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:37:20.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:21.598 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-18T15:37:23.583 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-18T15:37:24.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:27.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:27.614 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:37:29.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:33.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:36.670 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:37:42.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:37:45.726 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2024-03-18T15:37:51.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:38:27.639 WARNING:teuthology.provision.fog.smithi169:timed out
2024-03-18T15:38:29.591 WARNING:teuthology.provision.fog.smithi165:timed out
2024-03-18T15:38:33.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:38:33.900 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-18T15:38:33.901 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-18T15:38:34.177 INFO:teuthology.provision.fog.smithi169:Node is ready
2024-03-18T15:38:34.178 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2024-03-18T15:38:34.197 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2024-03-18T15:38:34.197 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2024-03-18T15:38:34.257 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2024-03-18T15:38:34.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2024-03-18T15:38:34.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2024-03-18T15:38:34.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2024-03-18T15:38:34.454 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2024-03-18T15:38:34.523 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2024-03-18T15:38:34.590 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2024-03-18T15:38:34.648 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2024-03-18T15:38:34.648 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8"
2024-03-18T15:38:34.648 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2024-03-18T15:38:34.648 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2024-03-18T15:38:34.648 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8"
2024-03-18T15:38:34.649 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2024-03-18T15:38:34.649 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T15:38:34.649 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2024-03-18T15:38:34.649 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T15:38:34.649 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2024-03-18T15:38:34.649 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T15:38:34.649 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T15:38:34.649 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T15:38:34.650 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2024-03-18T15:38:34.651 DEBUG:teuthology.parallel:result is None
2024-03-18T15:38:35.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:38:35.831 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-18T15:38:35.832 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-18T15:38:36.061 INFO:teuthology.provision.fog.smithi165:Node is ready
2024-03-18T15:38:36.061 DEBUG:teuthology.orchestra.run.smithi165:> hostname
2024-03-18T15:38:36.080 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165
2024-03-18T15:38:36.081 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165 /etc/hosts
2024-03-18T15:38:36.141 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2024-03-18T15:38:36.142 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-03-18T15:38:36.261 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165/smithi165/g' /etc/hosts
2024-03-18T15:38:36.290 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts
2024-03-18T15:38:36.360 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165/smithi165/g' /etc/hostname
2024-03-18T15:38:36.429 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-03-18T15:38:36.496 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-03-18T15:38:36.554 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-03-18T15:38:36.554 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2024-03-18T15:38:36.554 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-03-18T15:38:36.554 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-03-18T15:38:36.554 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2024-03-18T15:38:36.554 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2024-03-18T15:38:36.554 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T15:38:36.555 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-03-18T15:38:36.555 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T15:38:36.555 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-03-18T15:38:36.555 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T15:38:36.555 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T15:38:36.555 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T15:38:36.555 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2024-03-18T15:38:36.556 DEBUG:teuthology.parallel:result is None
2024-03-18T15:38:51.738 WARNING:teuthology.provision.fog.smithi023:timed out
2024-03-18T15:38:57.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:38:57.943 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-18T15:38:57.943 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-18T15:38:58.212 INFO:teuthology.provision.fog.smithi023:Node is ready
2024-03-18T15:38:58.212 DEBUG:teuthology.orchestra.run.smithi023:> hostname
2024-03-18T15:38:58.231 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2024-03-18T15:38:58.231 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts
2024-03-18T15:38:58.291 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2024-03-18T15:38:58.291 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023
2024-03-18T15:38:58.406 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts
2024-03-18T15:38:58.436 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts
2024-03-18T15:38:58.505 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname
2024-03-18T15:38:58.573 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023
2024-03-18T15:38:58.641 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release
2024-03-18T15:38:58.700 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream"
2024-03-18T15:38:58.700 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8"
2024-03-18T15:38:58.700 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos"
2024-03-18T15:38:58.700 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora"
2024-03-18T15:38:58.700 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8"
2024-03-18T15:38:58.700 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2024-03-18T15:38:58.701 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T15:38:58.701 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2024-03-18T15:38:58.701 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T15:38:58.701 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/"
2024-03-18T15:38:58.701 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T15:38:58.701 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T15:38:58.701 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T15:38:58.701 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2024-03-18T15:38:58.702 DEBUG:teuthology.parallel:result is None
2024-03-18T15:38:58.926 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2024-03-18T15:38:58.927 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-18T15:38:58.951 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2024-03-18T15:38:58.951 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-18T15:38:58.967 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2024-03-18T15:38:58.967 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-18T15:38:58.985 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2024-03-18T15:38:58.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2024-03-18T15:38:58.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:38:59.055 DEBUG:teuthology.orchestra.run.smithi023:> true
2024-03-18T15:38:59.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com'
2024-03-18T15:38:59.124 DEBUG:teuthology.orchestra.run.smithi023:> uname -m
2024-03-18T15:38:59.183 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2024-03-18T15:38:59.183 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release
2024-03-18T15:38:59.240 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream"
2024-03-18T15:38:59.240 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8"
2024-03-18T15:38:59.240 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T15:38:59.241 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T15:38:59.241 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2024-03-18T15:38:59.268 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2024-03-18T15:38:59.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-03-18T15:38:59.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:38:59.339 DEBUG:teuthology.orchestra.run.smithi165:> true
2024-03-18T15:38:59.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-03-18T15:38:59.473 DEBUG:teuthology.orchestra.run.smithi165:> uname -m
2024-03-18T15:38:59.531 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2024-03-18T15:38:59.532 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-03-18T15:38:59.591 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T15:38:59.592 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T15:38:59.592 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T15:38:59.592 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-03-18T15:38:59.609 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2024-03-18T15:38:59.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2024-03-18T15:38:59.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-18T15:38:59.682 DEBUG:teuthology.orchestra.run.smithi169:> true
2024-03-18T15:38:59.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2024-03-18T15:38:59.821 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2024-03-18T15:38:59.880 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2024-03-18T15:38:59.881 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2024-03-18T15:38:59.939 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2024-03-18T15:38:59.939 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8"
2024-03-18T15:38:59.939 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2024-03-18T15:38:59.939 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2024-03-18T15:38:59.939 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8"
2024-03-18T15:38:59.939 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2024-03-18T15:38:59.940 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-18T15:38:59.940 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2024-03-18T15:38:59.940 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-18T15:38:59.940 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2024-03-18T15:38:59.940 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-18T15:38:59.940 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-18T15:38:59.940 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-18T15:38:59.940 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2024-03-18T15:38:59.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:39:00.044 INFO:teuthology.dispatcher.supervisor:Running job 7608898
2024-03-18T15:39:00.044 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608898 --name pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608898/orig.config.yaml
2024-03-18T15:39:00.047 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608898
2024-03-18T15:39:00.047 INFO:teuthology.dispatcher.supervisor:Job PID: 1041779
2024-03-18T15:39:00.047 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-18T15:41:00.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:43:00.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:45:00.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:47:00.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:49:00.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:51:01.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:53:01.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:55:01.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:57:01.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T15:59:01.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T16:01:01.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T16:03:02.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T16:05:02.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T16:05:02.354 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1