2024-04-14T08:09:33.425 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60
2024-04-14T08:09:33.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:09:33.827 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbc87c66f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbc88cc7c10>, signals=[15])
2024-04-14T08:09:33.828 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging
2024-04-14T08:09:33.828 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T08:09:33.828 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2024-04-14T08:09:33.847 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging
2024-04-14T08:09:33.847 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T08:09:33.848 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2024-04-14T08:09:33.872 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging
2024-04-14T08:09:33.872 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server
2024-04-14T08:09:33.872 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2024-04-14T08:09:33.971 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T08:09:33.987 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T08:09:34.007 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10)
2024-04-14T08:09:34.010 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 9.stream
2024-04-14T08:09:34.034 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 9.stream
2024-04-14T08:09:34.054 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream
2024-04-14T08:09:34.303 INFO:teuthology.orchestra.console.smithi078:Power off
2024-04-14T08:09:34.304 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T08:09:34.318 INFO:teuthology.orchestra.console.smithi117:Power off
2024-04-14T08:09:34.318 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T08:09:34.330 INFO:teuthology.orchestra.console.smithi188:Power off
2024-04-14T08:09:34.331 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-14T08:09:34.338 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off
2024-04-14T08:09:34.338 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:34.345 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off
2024-04-14T08:09:34.345 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:34.353 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off
2024-04-14T08:09:34.354 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:34.363 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2024-04-14T08:09:34.368 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-04-14T08:09:34.378 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2024-04-14T08:09:38.366 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:38.373 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:38.380 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:38.476 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2024-04-14T08:09:38.482 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-04-14T08:09:38.489 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2024-04-14T08:09:42.481 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:42.488 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:42.494 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:42.590 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2024-04-14T08:09:42.596 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-04-14T08:09:42.603 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2024-04-14T08:09:42.697 INFO:teuthology.orchestra.console.smithi078:Power off completed
2024-04-14T08:09:42.704 INFO:teuthology.orchestra.console.smithi188:Power off completed
2024-04-14T08:09:42.799 INFO:teuthology.orchestra.console.smithi078:Power on
2024-04-14T08:09:42.799 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T08:09:42.807 INFO:teuthology.orchestra.console.smithi188:Power on
2024-04-14T08:09:42.807 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T08:09:42.821 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On
2024-04-14T08:09:42.821 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:42.830 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On
2024-04-14T08:09:42.830 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:42.843 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-04-14T08:09:42.853 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2024-04-14T08:09:46.594 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:46.703 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-04-14T08:09:46.804 INFO:teuthology.orchestra.console.smithi117:Power off completed
2024-04-14T08:09:46.844 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:46.854 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:46.905 INFO:teuthology.orchestra.console.smithi117:Power on
2024-04-14T08:09:46.905 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-14T08:09:46.927 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On
2024-04-14T08:09:46.927 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:46.952 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-04-14T08:09:46.953 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2024-04-14T08:09:46.962 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2024-04-14T08:09:47.063 INFO:teuthology.orchestra.console.smithi188:Power on completed
2024-04-14T08:09:47.164 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2024-04-14T08:09:50.954 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:50.961 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-14T08:09:51.064 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2024-04-14T08:09:51.070 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2024-04-14T08:09:51.165 INFO:teuthology.orchestra.console.smithi117:Power on completed
2024-04-14T08:09:51.170 INFO:teuthology.orchestra.console.smithi078:Power on completed
2024-04-14T08:09:51.266 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2024-04-14T08:09:51.271 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2024-04-14T08:12:22.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:25.182 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-14T08:12:31.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:33.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:34.242 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-14T08:12:36.258 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:12:37.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:40.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:40.254 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-14T08:12:42.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:43.326 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-14T08:12:45.342 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:12:46.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:49.310 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-14T08:12:49.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:51.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:52.382 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-14T08:12:54.398 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:12:55.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:12:58.370 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-14T08:12:58.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:00.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:01.442 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-14T08:13:03.458 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:13:04.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:07.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:07.458 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-14T08:13:09.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:10.526 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2024-04-14T08:13:12.542 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:13:13.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:16.514 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-14T08:13:16.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:18.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:21.598 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:13:22.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:25.602 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-14T08:13:27.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:31.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:46.145 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:13:52.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:13:55.230 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:14:01.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:14:04.286 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-04-14T08:14:10.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:14:10.555 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T08:14:10.555 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T08:14:16.531 WARNING:teuthology.provision.fog.smithi078:timed out
2024-04-14T08:14:22.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:14:22.873 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T08:14:22.874 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T08:14:23.198 INFO:teuthology.provision.fog.smithi078:Node is ready
2024-04-14T08:14:23.198 DEBUG:teuthology.orchestra.run.smithi078:> hostname
2024-04-14T08:14:23.213 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2024-04-14T08:14:23.213 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts
2024-04-14T08:14:23.271 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2024-04-14T08:14:23.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2024-04-14T08:14:23.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts
2024-04-14T08:14:23.412 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts
2024-04-14T08:14:23.479 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname
2024-04-14T08:14:23.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2024-04-14T08:14:23.612 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2024-04-14T08:14:23.667 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2024-04-14T08:14:23.668 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T08:14:23.669 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T08:14:23.669 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T08:14:23.669 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2024-04-14T08:14:23.671 DEBUG:teuthology.parallel:result is None
2024-04-14T08:14:26.055 INFO:teuthology.provision.fog.smithi188:Node is ready
2024-04-14T08:14:26.055 DEBUG:teuthology.orchestra.run.smithi188:> hostname
2024-04-14T08:14:26.113 INFO:teuthology.orchestra.run.smithi188.stdout:smithi046
2024-04-14T08:14:26.113 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi046 /etc/hosts
2024-04-14T08:14:26.171 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-04-14T08:14:26.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2024-04-14T08:14:26.336 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi046/smithi188/g' /etc/hosts
2024-04-14T08:14:26.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.46/172.21.15.188/g' /etc/hosts
2024-04-14T08:14:26.440 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi046/smithi188/g' /etc/hostname
2024-04-14T08:14:26.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2024-04-14T08:14:26.575 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2024-04-14T08:14:26.630 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2024-04-14T08:14:26.630 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T08:14:26.631 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T08:14:26.632 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2024-04-14T08:14:26.632 DEBUG:teuthology.parallel:result is None
2024-04-14T08:14:31.614 WARNING:teuthology.provision.fog.smithi117:timed out
2024-04-14T08:14:37.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:14:37.876 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-14T08:14:37.876 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-14T08:14:38.217 INFO:teuthology.provision.fog.smithi117:Node is ready
2024-04-14T08:14:38.217 DEBUG:teuthology.orchestra.run.smithi117:> hostname
2024-04-14T08:14:38.232 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2024-04-14T08:14:38.233 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts
2024-04-14T08:14:38.286 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2024-04-14T08:14:38.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2024-04-14T08:14:38.396 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts
2024-04-14T08:14:38.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts
2024-04-14T08:14:38.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname
2024-04-14T08:14:38.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2024-04-14T08:14:38.620 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2024-04-14T08:14:38.673 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream"
2024-04-14T08:14:38.673 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9"
2024-04-14T08:14:38.673 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2024-04-14T08:14:38.673 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T08:14:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T08:14:38.674 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2024-04-14T08:14:38.675 DEBUG:teuthology.parallel:result is None
2024-04-14T08:14:38.892 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2024-04-14T08:14:38.893 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T08:14:38.913 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2024-04-14T08:14:38.913 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T08:14:38.929 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2024-04-14T08:14:38.929 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-14T08:14:38.947 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2024-04-14T08:14:38.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2024-04-14T08:14:38.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:14:39.036 DEBUG:teuthology.orchestra.run.smithi078:> true
2024-04-14T08:14:39.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com'
2024-04-14T08:14:39.205 DEBUG:teuthology.orchestra.run.smithi078:> uname -m
2024-04-14T08:14:39.259 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2024-04-14T08:14:39.260 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2024-04-14T08:14:39.314 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2024-04-14T08:14:39.314 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9"
2024-04-14T08:14:39.314 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2024-04-14T08:14:39.314 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2024-04-14T08:14:39.314 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9"
2024-04-14T08:14:39.314 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9"
2024-04-14T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2024-04-14T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon"
2024-04-14T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2024-04-14T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T08:14:39.315 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T08:14:39.315 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2024-04-14T08:14:39.338 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2024-04-14T08:14:39.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2024-04-14T08:14:39.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:14:39.426 DEBUG:teuthology.orchestra.run.smithi117:> true
2024-04-14T08:14:39.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com'
2024-04-14T08:14:39.492 DEBUG:teuthology.orchestra.run.smithi117:> uname -m
2024-04-14T08:14:39.545 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2024-04-14T08:14:39.546 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2024-04-14T08:14:39.599 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream"
2024-04-14T08:14:39.599 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9"
2024-04-14T08:14:39.599 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2024-04-14T08:14:39.599 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2024-04-14T08:14:39.599 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9"
2024-04-14T08:14:39.599 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9"
2024-04-14T08:14:39.599 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T08:14:39.599 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2024-04-14T08:14:39.600 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon"
2024-04-14T08:14:39.600 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T08:14:39.600 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/"
2024-04-14T08:14:39.600 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T08:14:39.600 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T08:14:39.600 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T08:14:39.600 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2024-04-14T08:14:39.622 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2024-04-14T08:14:39.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2024-04-14T08:14:39.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-14T08:14:39.744 DEBUG:teuthology.orchestra.run.smithi188:> true
2024-04-14T08:14:39.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com'
2024-04-14T08:14:39.917 DEBUG:teuthology.orchestra.run.smithi188:> uname -m
2024-04-14T08:14:39.975 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2024-04-14T08:14:39.975 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9"
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9"
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9"
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2024-04-14T08:14:40.033 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon"
2024-04-14T08:14:40.034 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-14T08:14:40.034 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2024-04-14T08:14:40.034 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-14T08:14:40.034 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-14T08:14:40.034 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-14T08:14:40.034 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2024-04-14T08:14:40.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:14:40.153 INFO:teuthology.dispatcher.supervisor:Running job 7638360
2024-04-14T08:14:40.154 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638360 --name teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638360/orig.config.yaml
2024-04-14T08:14:40.158 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638360
2024-04-14T08:14:40.158 INFO:teuthology.dispatcher.supervisor:Job PID: 1981939
2024-04-14T08:14:40.159 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-14T08:16:40.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:18:40.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:20:40.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:22:40.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:24:40.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:26:41.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:28:41.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-14T08:28:41.395 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1