2024-02-21T07:08:31.317 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-21T07:08:31.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:08:31.496 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd3fbcdcf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd3fcd50c10>, signals=[15])
2024-02-21T07:08:31.496 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging
2024-02-21T07:08:31.496 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T07:08:31.497 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-02-21T07:08:31.522 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2024-02-21T07:08:31.522 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T07:08:31.522 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2024-02-21T07:08:31.547 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging
2024-02-21T07:08:31.547 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T07:08:31.547 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server
2024-02-21T07:08:31.624 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T07:08:31.642 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T07:08:31.682 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 9.stream
2024-02-21T07:08:31.686 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 9.stream
2024-02-21T07:08:31.686 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T07:08:31.729 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 9.stream
2024-02-21T07:08:32.050 INFO:teuthology.orchestra.console.smithi073:Power off
2024-02-21T07:08:32.050 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T07:08:32.065 INFO:teuthology.orchestra.console.smithi046:Power off
2024-02-21T07:08:32.065 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T07:08:32.073 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off
2024-02-21T07:08:32.073 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:32.093 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2024-02-21T07:08:32.093 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:32.102 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-02-21T07:08:32.118 INFO:teuthology.orchestra.console.smithi116:Power off
2024-02-21T07:08:32.118 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T07:08:32.127 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-02-21T07:08:32.139 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off
2024-02-21T07:08:32.140 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:32.162 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off
2024-02-21T07:08:32.202 INFO:teuthology.orchestra.console.smithi073:Power off completed
2024-02-21T07:08:32.228 INFO:teuthology.orchestra.console.smithi046:Power off completed
2024-02-21T07:08:32.262 INFO:teuthology.orchestra.console.smithi116:Power off completed
2024-02-21T07:08:32.304 INFO:teuthology.orchestra.console.smithi073:Power on
2024-02-21T07:08:32.304 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T07:08:32.326 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On
2024-02-21T07:08:32.327 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:32.335 INFO:teuthology.orchestra.console.smithi046:Power on
2024-02-21T07:08:32.335 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T07:08:32.352 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-02-21T07:08:32.356 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On
2024-02-21T07:08:32.356 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:32.364 INFO:teuthology.orchestra.console.smithi116:Power on
2024-02-21T07:08:32.364 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T07:08:32.379 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-02-21T07:08:32.384 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On
2024-02-21T07:08:32.384 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:32.405 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off
2024-02-21T07:08:36.356 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:36.381 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:36.406 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:36.465 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-02-21T07:08:36.489 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-02-21T07:08:36.514 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off
2024-02-21T07:08:40.470 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:40.490 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:40.515 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:08:40.600 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-02-21T07:08:40.625 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on
2024-02-21T07:08:40.681 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-02-21T07:08:40.701 INFO:teuthology.orchestra.console.smithi046:Power on completed
2024-02-21T07:08:40.725 INFO:teuthology.orchestra.console.smithi116:Power on completed
2024-02-21T07:08:40.782 INFO:teuthology.orchestra.console.smithi073:Power on completed
2024-02-21T07:08:40.802 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish
2024-02-21T07:08:40.826 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish
2024-02-21T07:08:40.884 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2024-02-21T07:11:57.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:00.956 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:12:06.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:10.016 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:12:16.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:19.104 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:12:25.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:28.188 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:12:34.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:37.276 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:12:43.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:43.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:43.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:46.172 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:12:46.172 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-02-21T07:12:46.332 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:12:52.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:52.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:52.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:12:55.228 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:12:55.228 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-02-21T07:13:01.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:01.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:02.524 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:13:04.284 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:13:04.284 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-02-21T07:13:08.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:10.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:10.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:11.584 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:13:13.340 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:13:13.340 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-02-21T07:13:17.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:19.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:19.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:20.668 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2024-02-21T07:13:22.400 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:13:22.400 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-02-21T07:13:26.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:28.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:28.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:28.793 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T07:13:28.793 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T07:13:31.452 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:13:31.452 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-02-21T07:13:37.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:37.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:40.508 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-02-21T07:13:46.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:13:49.001 INFO:teuthology.provision.fog.smithi116:Node is ready
2024-02-21T07:13:49.001 DEBUG:teuthology.orchestra.run.smithi116:> hostname
2024-02-21T07:13:49.019 INFO:teuthology.orchestra.run.smithi116.stdout:smithi046
2024-02-21T07:13:49.020 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi046 /etc/hosts
2024-02-21T07:13:49.077 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-02-21T07:13:49.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116
2024-02-21T07:13:49.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi046/smithi116/g' /etc/hosts
2024-02-21T07:13:49.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.46/172.21.15.116/g' /etc/hosts
2024-02-21T07:13:49.353 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi046/smithi116/g' /etc/hostname
2024-02-21T07:13:49.422 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116
2024-02-21T07:13:49.490 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:13:49.546 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:13:49.547 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:13:49.547 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:13:49.547 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:13:49.547 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:13:49.547 INFO:teuthology.provision.fog.smithi116:Deploy complete!
2024-02-21T07:13:49.549 DEBUG:teuthology.parallel:result is None
2024-02-21T07:13:55.772 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:14:01.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:14:04.864 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:14:10.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:14:13.948 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-21T07:14:19.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:14:20.244 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T07:14:20.244 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T07:14:40.604 INFO:teuthology.provision.fog.smithi073:Node is ready
2024-02-21T07:14:40.604 DEBUG:teuthology.orchestra.run.smithi073:> hostname
2024-02-21T07:14:40.663 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2024-02-21T07:14:40.663 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts
2024-02-21T07:14:40.720 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2024-02-21T07:14:40.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2024-02-21T07:14:40.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts
2024-02-21T07:14:40.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts
2024-02-21T07:14:40.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname
2024-02-21T07:14:41.015 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2024-02-21T07:14:41.082 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2024-02-21T07:14:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2024-02-21T07:14:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9"
2024-02-21T07:14:41.137 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:14:41.138 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:14:41.139 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2024-02-21T07:14:41.139 DEBUG:teuthology.parallel:result is None
2024-02-21T07:14:46.511 WARNING:teuthology.provision.fog.smithi046:timed out
2024-02-21T07:14:52.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:14:52.790 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T07:14:52.790 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T07:14:53.149 INFO:teuthology.provision.fog.smithi046:Node is ready
2024-02-21T07:14:53.149 DEBUG:teuthology.orchestra.run.smithi046:> hostname
2024-02-21T07:14:53.164 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com
2024-02-21T07:14:53.165 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts
2024-02-21T07:14:53.220 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-02-21T07:14:53.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-02-21T07:14:53.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts
2024-02-21T07:14:53.369 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts
2024-02-21T07:14:53.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname
2024-02-21T07:14:53.511 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-02-21T07:14:53.581 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-02-21T07:14:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream"
2024-02-21T07:14:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9"
2024-02-21T07:14:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos"
2024-02-21T07:14:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:14:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9"
2024-02-21T07:14:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:14:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:14:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31"
2024-02-21T07:14:53.637 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:14:53.637 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:14:53.637 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:14:53.637 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:14:53.637 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:14:53.637 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:14:53.637 INFO:teuthology.provision.fog.smithi046:Deploy complete!
2024-02-21T07:14:53.638 DEBUG:teuthology.parallel:result is None
2024-02-21T07:14:53.856 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com
2024-02-21T07:14:53.857 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T07:14:53.884 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2024-02-21T07:14:53.884 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T07:14:53.909 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com
2024-02-21T07:14:53.909 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T07:14:53.926 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server
2024-02-21T07:14:53.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-02-21T07:14:53.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:14:54.029 DEBUG:teuthology.orchestra.run.smithi046:> true
2024-02-21T07:14:54.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-02-21T07:14:54.102 DEBUG:teuthology.orchestra.run.smithi046:> uname -m
2024-02-21T07:14:54.156 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64
2024-02-21T07:14:54.157 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-02-21T07:14:54.210 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:14:54.211 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:14:54.212 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-02-21T07:14:54.234 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2024-02-21T07:14:54.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2024-02-21T07:14:54.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:14:54.321 DEBUG:teuthology.orchestra.run.smithi073:> true
2024-02-21T07:14:54.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com'
2024-02-21T07:14:54.393 DEBUG:teuthology.orchestra.run.smithi073:> uname -m
2024-02-21T07:14:54.449 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2024-02-21T07:14:54.450 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2024-02-21T07:14:54.506 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:14:54.507 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:14:54.508 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:14:54.508 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2024-02-21T07:14:54.534 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server
2024-02-21T07:14:54.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com'
2024-02-21T07:14:54.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:14:54.620 DEBUG:teuthology.orchestra.run.smithi116:> true
2024-02-21T07:14:54.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com'
2024-02-21T07:14:54.786 DEBUG:teuthology.orchestra.run.smithi116:> uname -m
2024-02-21T07:14:54.840 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64
2024-02-21T07:14:54.840 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release
2024-02-21T07:14:54.894 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:14:54.895 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:14:54.896 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server
2024-02-21T07:14:54.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:14:55.018 INFO:teuthology.dispatcher.supervisor:Running job 7569289
2024-02-21T07:14:55.019 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569289 --name vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569289/orig.config.yaml
2024-02-21T07:14:55.022 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569289
2024-02-21T07:14:55.022 INFO:teuthology.dispatcher.supervisor:Job PID: 109969
2024-02-21T07:14:55.022 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-21T07:16:55.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:18:55.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:20:55.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:22:55.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:24:55.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:26:55.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:28:55.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:30:55.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:30:55.610 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1