2023-12-05T17:15:50.955 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-05T17:15:50.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:15:51.290 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f83b76b9400>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f83b8597550>, signals=[15])
2023-12-05T17:15:51.290 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging
2023-12-05T17:15:51.291 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server
2023-12-05T17:15:51.291 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2023-12-05T17:15:51.315 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-12-05T17:15:51.316 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-12-05T17:15:51.316 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-12-05T17:15:51.339 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging
2023-12-05T17:15:51.339 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server
2023-12-05T17:15:51.339 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2023-12-05T17:15:51.375 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2023-12-05T17:15:51.375 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2023-12-05T17:15:51.375 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-12-05T17:15:51.455 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10)
2023-12-05T17:15:51.456 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_9.stream (ID 10)
2023-12-05T17:15:51.496 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_9.stream (ID 10)
2023-12-05T17:15:51.502 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream
2023-12-05T17:15:51.509 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 9.stream
2023-12-05T17:15:51.524 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_9.stream (ID 10)
2023-12-05T17:15:51.549 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 9.stream
2023-12-05T17:15:51.564 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 9.stream
2023-12-05T17:15:51.770 INFO:teuthology.orchestra.console.smithi093:Power off
2023-12-05T17:15:51.771 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T17:15:51.815 INFO:teuthology.orchestra.console.smithi044:Power off
2023-12-05T17:15:51.815 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T17:15:51.857 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-12-05T17:15:51.858 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:51.896 INFO:teuthology.orchestra.console.smithi124:Power off
2023-12-05T17:15:51.896 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T17:15:51.956 INFO:teuthology.orchestra.console.smithi094:Power off
2023-12-05T17:15:51.957 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T17:15:51.995 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-12-05T17:15:51.995 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:52.005 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-12-05T17:15:52.006 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2023-12-05T17:15:52.006 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:52.048 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2023-12-05T17:15:52.049 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:52.077 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-05T17:15:52.099 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-12-05T17:15:52.107 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-12-05T17:15:52.111 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-12-05T17:15:52.178 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-12-05T17:15:52.200 INFO:teuthology.orchestra.console.smithi044:Power off completed
2023-12-05T17:15:52.208 INFO:teuthology.orchestra.console.smithi093:Power on
2023-12-05T17:15:52.208 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-05T17:15:52.216 INFO:teuthology.orchestra.console.smithi094:Power off completed
2023-12-05T17:15:52.272 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On
2023-12-05T17:15:52.272 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:52.287 INFO:teuthology.orchestra.console.smithi124:Power on
2023-12-05T17:15:52.288 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-05T17:15:52.320 INFO:teuthology.orchestra.console.smithi044:Power on
2023-12-05T17:15:52.320 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-05T17:15:52.341 INFO:teuthology.orchestra.console.smithi094:Power on
2023-12-05T17:15:52.342 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-05T17:15:52.359 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-12-05T17:15:52.381 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2023-12-05T17:15:52.381 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:52.401 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On
2023-12-05T17:15:52.401 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:52.417 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On
2023-12-05T17:15:52.418 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:52.462 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-05T17:15:52.488 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-12-05T17:15:52.490 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-12-05T17:15:56.362 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:56.463 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:56.488 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:56.505 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:15:56.534 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-12-05T17:15:56.580 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-05T17:15:56.611 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-12-05T17:15:56.635 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-12-05T17:15:56.635 INFO:teuthology.orchestra.console.smithi093:Power on completed
2023-12-05T17:15:56.681 INFO:teuthology.orchestra.console.smithi124:Power on completed
2023-12-05T17:15:56.737 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-12-05T17:15:56.783 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2023-12-05T17:16:00.616 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:16:00.642 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T17:16:00.745 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2023-12-05T17:16:00.758 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2023-12-05T17:16:00.846 INFO:teuthology.orchestra.console.smithi044:Power on completed
2023-12-05T17:16:00.860 INFO:teuthology.orchestra.console.smithi094:Power on completed
2023-12-05T17:16:00.947 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish
2023-12-05T17:16:00.961 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish
2023-12-05T17:18:31.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:18:42.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:18:42.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:18:47.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:18:50.470 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2023-12-05T17:18:56.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:18:59.554 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2023-12-05T17:19:01.218 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-05T17:19:01.219 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-12-05T17:19:05.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:05.570 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-12-05T17:19:07.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:07.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:08.642 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2023-12-05T17:19:10.275 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-05T17:19:10.276 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-12-05T17:19:11.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:14.626 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-12-05T17:19:14.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:16.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:16.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:17.698 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2023-12-05T17:19:19.330 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-05T17:19:19.366 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-12-05T17:19:20.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:23.682 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-12-05T17:19:23.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:25.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:25.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:28.386 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-05T17:19:28.454 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-12-05T17:19:29.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:32.738 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-12-05T17:19:34.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:34.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:37.442 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-05T17:19:38.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:19:43.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:23.742 WARNING:teuthology.provision.fog.smithi044:timed out
2023-12-05T17:20:29.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:29.966 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-05T17:20:29.966 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-05T17:20:30.296 INFO:teuthology.provision.fog.smithi044:Node is ready
2023-12-05T17:20:30.297 DEBUG:teuthology.orchestra.run.smithi044:> hostname
2023-12-05T17:20:30.314 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com
2023-12-05T17:20:30.314 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts
2023-12-05T17:20:30.370 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044
2023-12-05T17:20:30.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2023-12-05T17:20:30.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts
2023-12-05T17:20:30.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts
2023-12-05T17:20:30.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname
2023-12-05T17:20:30.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2023-12-05T17:20:30.731 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2023-12-05T17:20:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2023-12-05T17:20:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2023-12-05T17:20:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2023-12-05T17:20:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2023-12-05T17:20:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2023-12-05T17:20:30.786 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2023-12-05T17:20:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-05T17:20:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2023-12-05T17:20:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2023-12-05T17:20:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-05T17:20:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2023-12-05T17:20:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-05T17:20:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-05T17:20:30.787 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-05T17:20:30.788 INFO:teuthology.provision.fog.smithi044:Deploy complete!
2023-12-05T17:20:30.789 DEBUG:teuthology.parallel:result is None
2023-12-05T17:20:34.462 WARNING:teuthology.provision.fog.smithi093:timed out
2023-12-05T17:20:38.746 WARNING:teuthology.provision.fog.smithi094:timed out
2023-12-05T17:20:40.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:40.684 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-05T17:20:40.685 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-05T17:20:41.011 INFO:teuthology.provision.fog.smithi093:Node is ready
2023-12-05T17:20:41.011 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2023-12-05T17:20:41.025 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com
2023-12-05T17:20:41.026 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts
2023-12-05T17:20:41.080 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2023-12-05T17:20:41.081 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-12-05T17:20:41.188 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts
2023-12-05T17:20:41.216 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2023-12-05T17:20:41.283 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname
2023-12-05T17:20:41.349 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-12-05T17:20:41.416 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-12-05T17:20:41.471 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2023-12-05T17:20:41.471 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9"
2023-12-05T17:20:41.472 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2023-12-05T17:20:41.472 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2023-12-05T17:20:41.472 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9"
2023-12-05T17:20:41.472 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9"
2023-12-05T17:20:41.472 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-05T17:20:41.473 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-12-05T17:20:41.473 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon"
2023-12-05T17:20:41.473 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-05T17:20:41.473 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2023-12-05T17:20:41.473 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-05T17:20:41.473 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-05T17:20:41.474 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-05T17:20:41.474 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2023-12-05T17:20:41.475 DEBUG:teuthology.parallel:result is None
2023-12-05T17:20:43.450 WARNING:teuthology.provision.fog.smithi124:timed out
2023-12-05T17:20:44.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:45.012 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-05T17:20:45.012 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-05T17:20:45.352 INFO:teuthology.provision.fog.smithi094:Node is ready
2023-12-05T17:20:45.352 DEBUG:teuthology.orchestra.run.smithi094:> hostname
2023-12-05T17:20:45.367 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com
2023-12-05T17:20:45.367 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts
2023-12-05T17:20:45.422 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094
2023-12-05T17:20:45.422 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2023-12-05T17:20:45.543 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts
2023-12-05T17:20:45.571 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts
2023-12-05T17:20:45.638 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname
2023-12-05T17:20:45.705 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2023-12-05T17:20:45.771 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2023-12-05T17:20:45.825 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-05T17:20:45.826 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-05T17:20:45.827 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-05T17:20:45.827 INFO:teuthology.provision.fog.smithi094:Deploy complete!
2023-12-05T17:20:45.827 DEBUG:teuthology.parallel:result is None
2023-12-05T17:20:49.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:49.960 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-05T17:20:49.960 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-05T17:20:50.281 INFO:teuthology.provision.fog.smithi124:Node is ready
2023-12-05T17:20:50.281 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2023-12-05T17:20:50.295 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2023-12-05T17:20:50.296 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2023-12-05T17:20:50.347 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2023-12-05T17:20:50.348 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-12-05T17:20:50.456 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2023-12-05T17:20:50.485 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2023-12-05T17:20:50.549 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2023-12-05T17:20:50.615 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-12-05T17:20:50.681 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-12-05T17:20:50.732 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-12-05T17:20:50.732 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-12-05T17:20:50.732 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-12-05T17:20:50.732 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-12-05T17:20:50.732 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-12-05T17:20:50.732 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-12-05T17:20:50.732 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-05T17:20:50.732 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-12-05T17:20:50.733 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-12-05T17:20:50.733 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-05T17:20:50.733 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-12-05T17:20:50.733 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-05T17:20:50.733 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-05T17:20:50.733 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-05T17:20:50.733 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2023-12-05T17:20:50.734 DEBUG:teuthology.parallel:result is None
2023-12-05T17:20:50.992 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com
2023-12-05T17:20:50.992 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-05T17:20:51.016 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2023-12-05T17:20:51.017 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-05T17:20:51.033 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com
2023-12-05T17:20:51.033 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-05T17:20:51.049 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2023-12-05T17:20:51.049 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-05T17:20:51.095 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server
2023-12-05T17:20:51.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-12-05T17:20:51.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:51.194 DEBUG:teuthology.orchestra.run.smithi044:> true
2023-12-05T17:20:51.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-12-05T17:20:51.378 DEBUG:teuthology.orchestra.run.smithi044:> uname -m
2023-12-05T17:20:51.434 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64
2023-12-05T17:20:51.434 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2023-12-05T17:20:51.490 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2023-12-05T17:20:51.491 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2023-12-05T17:20:51.491 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2023-12-05T17:20:51.491 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2023-12-05T17:20:51.491 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2023-12-05T17:20:51.491 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2023-12-05T17:20:51.492 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-05T17:20:51.492 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2023-12-05T17:20:51.492 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2023-12-05T17:20:51.492 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-05T17:20:51.493 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2023-12-05T17:20:51.493 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-05T17:20:51.493 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-05T17:20:51.493 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-05T17:20:51.494 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2023-12-05T17:20:51.517 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2023-12-05T17:20:51.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-12-05T17:20:51.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:51.600 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-12-05T17:20:51.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-12-05T17:20:51.671 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2023-12-05T17:20:51.729 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2023-12-05T17:20:51.730 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-12-05T17:20:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2023-12-05T17:20:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9"
2023-12-05T17:20:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2023-12-05T17:20:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2023-12-05T17:20:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9"
2023-12-05T17:20:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9"
2023-12-05T17:20:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-05T17:20:51.787 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-12-05T17:20:51.788 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon"
2023-12-05T17:20:51.788 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-05T17:20:51.788 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2023-12-05T17:20:51.788 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-05T17:20:51.788 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-05T17:20:51.788 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-05T17:20:51.788 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-12-05T17:20:51.817 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server
2023-12-05T17:20:51.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com'
2023-12-05T17:20:51.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:51.903 DEBUG:teuthology.orchestra.run.smithi094:> true
2023-12-05T17:20:51.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com'
2023-12-05T17:20:51.976 DEBUG:teuthology.orchestra.run.smithi094:> uname -m
2023-12-05T17:20:52.032 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64
2023-12-05T17:20:52.033 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/"
2023-12-05T17:20:52.090 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-05T17:20:52.091 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-05T17:20:52.091 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-05T17:20:52.091 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2023-12-05T17:20:52.121 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2023-12-05T17:20:52.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-12-05T17:20:52.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T17:20:52.203 DEBUG:teuthology.orchestra.run.smithi124:> true
2023-12-05T17:20:52.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-12-05T17:20:52.275 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2023-12-05T17:20:52.331 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2023-12-05T17:20:52.332 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-12-05T17:20:52.385 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-12-05T17:20:52.386 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-12-05T17:20:52.386 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-12-05T17:20:52.386 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-12-05T17:20:52.386 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-12-05T17:20:52.386 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-12-05T17:20:52.386 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-05T17:20:52.387 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-12-05T17:20:52.387 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-12-05T17:20:52.387 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-05T17:20:52.387 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-12-05T17:20:52.387 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-05T17:20:52.387 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-05T17:20:52.388 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-05T17:20:52.388 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-12-05T17:20:52.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:20:52.505 INFO:teuthology.dispatcher.supervisor:Running job 7477991
2023-12-05T17:20:52.505 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_smanjara@teuthology --archive /home/teuthworker/archive/smanjara-2023-12-05_17:14:18-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7477991 --name smanjara-2023-12-05_17:14:18-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi --description rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/smanjara-2023-12-05_17:14:18-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7477991/orig.config.yaml
2023-12-05T17:20:52.509 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/smanjara-2023-12-05_17:14:18-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7477991
2023-12-05T17:20:52.510 INFO:teuthology.dispatcher.supervisor:Job PID: 1870047
2023-12-05T17:20:52.510 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-05T17:22:52.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:24:52.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:26:52.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:28:53.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:30:53.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:32:53.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:34:53.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:36:53.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:38:53.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:40:53.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:42:54.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:44:54.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:46:54.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:48:54.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:50:54.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:52:54.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:54:55.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:56:55.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T17:58:55.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:00:55.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:02:55.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:04:55.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:06:56.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:08:56.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:10:56.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:12:56.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:14:56.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:16:56.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:18:57.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:20:57.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:22:57.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:24:57.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:26:57.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:28:57.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:30:58.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:32:58.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:34:58.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:36:58.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:38:58.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:40:59.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:42:59.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:44:59.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:46:59.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:48:59.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:50:59.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:53:00.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:55:00.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:57:00.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T18:59:00.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:01:00.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:03:00.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:05:00.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:07:01.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:09:01.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:11:01.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:13:01.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:15:01.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:17:01.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:19:02.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:21:02.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:23:02.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:25:02.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:27:02.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:29:02.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T19:29:02.969 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-05T19:29:03.203 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-05T19:29:03.203 INFO:teuthology.nuke:Checking targets against current locks
2023-12-05T19:29:03.252 DEBUG:teuthology.nuke:shortname: smithi044
2023-12-05T19:29:03.252 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-05T19:29:03.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-05_17:14:18-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7477991', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 17:15:49.676790', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCj3M14ih4WnCwRQfXQmdHSP/uOx7HwlzFWU/be1AbsAzfzXmklbV7fMfX2GAcb49LH1p3F1Y7fhUixXHgA2SMg='}
2023-12-05T19:29:03.278 DEBUG:teuthology.nuke:shortname: smithi093
2023-12-05T19:29:03.278 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-05T19:29:03.305 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-05_17:14:18-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7477991', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 17:15:49.673788', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMRtD6GTok7xAd1nQkmRJrc/bP5Yp31GkKtrxbP+DsQF74ydJqmC3uoM/3K4XwOHL954WEkweVC/e7MmUL3FJn0='}
2023-12-05T19:29:03.309 DEBUG:teuthology.nuke:shortname: smithi094
2023-12-05T19:29:03.309 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-05T19:29:03.333 INFO:teuthology.orchestra.console.smithi044:Power off
2023-12-05T19:29:03.333 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T19:29:03.349 DEBUG:teuthology.nuke:shortname: smithi124
2023-12-05T19:29:03.350 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-05T19:29:03.351 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-05_17:14:18-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7477991', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 17:15:49.677943', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7xoofnQZwVC1eT9BXt286/6D871JsJDiiWoqdqe0ZOonsamieQSNRfHVrDRwL26gvJ08lRTkxUjhNCI8ar9m4='}
2023-12-05T19:29:03.369 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2023-12-05T19:29:03.370 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T19:29:03.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2023-12-05_17:14:18-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7477991', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 17:15:49.675648', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyQplK98qQT9Z1uXGpfOn0udJY6Xwq6vlxr+39rjx0EbfwsAghnweYT2Q+cwhibl2oaOMtBwfVqDK27nkUy93U='}
2023-12-05T19:29:03.400 INFO:teuthology.orchestra.console.smithi093:Power off
2023-12-05T19:29:03.400 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T19:29:03.413 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-12-05T19:29:03.424 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-12-05T19:29:03.424 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T19:29:03.447 INFO:teuthology.orchestra.console.smithi094:Power off
2023-12-05T19:29:03.447 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T19:29:03.460 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-12-05T19:29:03.474 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2023-12-05T19:29:03.474 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T19:29:03.494 INFO:teuthology.orchestra.console.smithi124:Power off
2023-12-05T19:29:03.494 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T19:29:03.503 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-12-05T19:29:03.515 INFO:teuthology.orchestra.console.smithi044:Power off completed
2023-12-05T19:29:03.523 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-12-05T19:29:03.523 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T19:29:03.545 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-05T19:29:03.562 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-12-05T19:29:03.604 INFO:teuthology.orchestra.console.smithi094:Power off completed
2023-12-05T19:29:03.646 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-12-05T19:29:03.660 INFO:teuthology.lock.ops:unlocked: smithi044.front.sepia.ceph.com
2023-12-05T19:29:03.710 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2023-12-05T19:29:03.754 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com
2023-12-05T19:29:03.793 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com