2024-04-16T13:08:32.777 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-16T13:08:32.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:08:32.953 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4c21917f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4c227b8c10>, signals=[15])
2024-04-16T13:08:32.954 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2024-04-16T13:08:32.954 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T13:08:32.954 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2024-04-16T13:08:32.975 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging
2024-04-16T13:08:32.975 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T13:08:32.975 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2024-04-16T13:08:32.991 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging
2024-04-16T13:08:32.991 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T13:08:32.991 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-04-16T13:08:33.077 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T13:08:33.099 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T13:08:33.132 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T13:08:33.139 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 9.stream
2024-04-16T13:08:33.154 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 9.stream
2024-04-16T13:08:33.174 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 9.stream
2024-04-16T13:08:33.419 INFO:teuthology.orchestra.console.smithi081:Power off
2024-04-16T13:08:33.419 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T13:08:33.435 INFO:teuthology.orchestra.console.smithi151:Power off
2024-04-16T13:08:33.436 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T13:08:33.447 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2024-04-16T13:08:33.447 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:33.457 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2024-04-16T13:08:33.458 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:33.469 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2024-04-16T13:08:33.474 INFO:teuthology.orchestra.console.smithi171:Power off
2024-04-16T13:08:33.474 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T13:08:33.489 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-04-16T13:08:33.494 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off
2024-04-16T13:08:33.494 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:33.514 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-04-16T13:08:33.614 INFO:teuthology.orchestra.console.smithi171:Power off completed
2024-04-16T13:08:33.715 INFO:teuthology.orchestra.console.smithi171:Power on
2024-04-16T13:08:33.715 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T13:08:33.737 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On
2024-04-16T13:08:33.737 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:33.760 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-04-16T13:08:37.474 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:37.491 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:37.585 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2024-04-16T13:08:37.599 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-04-16T13:08:37.761 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:37.869 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-04-16T13:08:37.970 INFO:teuthology.orchestra.console.smithi171:Power on completed
2024-04-16T13:08:38.071 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2024-04-16T13:08:41.587 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:41.601 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:41.696 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2024-04-16T13:08:41.709 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-04-16T13:08:45.698 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:45.710 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:45.807 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2024-04-16T13:08:45.818 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-04-16T13:08:45.909 INFO:teuthology.orchestra.console.smithi081:Power off completed
2024-04-16T13:08:45.919 INFO:teuthology.orchestra.console.smithi151:Power off completed
2024-04-16T13:08:46.009 INFO:teuthology.orchestra.console.smithi081:Power on
2024-04-16T13:08:46.010 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T13:08:46.020 INFO:teuthology.orchestra.console.smithi151:Power on
2024-04-16T13:08:46.021 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T13:08:46.031 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2024-04-16T13:08:46.031 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:46.042 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On
2024-04-16T13:08:46.043 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:46.051 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2024-04-16T13:08:46.064 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-04-16T13:08:50.056 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:50.065 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T13:08:50.166 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2024-04-16T13:08:50.174 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-04-16T13:08:50.267 INFO:teuthology.orchestra.console.smithi081:Power on completed
2024-04-16T13:08:50.274 INFO:teuthology.orchestra.console.smithi151:Power on completed
2024-04-16T13:08:50.368 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2024-04-16T13:08:50.375 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish
2024-04-16T13:11:21.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:23.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:24.293 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-16T13:11:26.978 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-16T13:11:30.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:32.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:33.374 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-16T13:11:36.066 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-16T13:11:39.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:42.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:42.430 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-16T13:11:45.154 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-16T13:11:48.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:51.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:51.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:11:51.486 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-16T13:11:54.238 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-16T13:11:54.430 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-16T13:11:57.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:00.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:00.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:00.542 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-16T13:12:03.298 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-16T13:12:03.490 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-16T13:12:06.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:09.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:09.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:09.598 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-16T13:12:12.382 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-04-16T13:12:12.542 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-16T13:12:15.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:18.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:18.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:21.598 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-16T13:12:27.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:30.654 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-16T13:12:36.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:39.710 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-16T13:12:45.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:12:48.770 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-16T13:12:54.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:13:15.626 WARNING:teuthology.provision.fog.smithi081:timed out
2024-04-16T13:13:18.389 WARNING:teuthology.provision.fog.smithi171:timed out
2024-04-16T13:13:21.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:13:21.889 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T13:13:21.889 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T13:13:22.208 INFO:teuthology.provision.fog.smithi081:Node is ready
2024-04-16T13:13:22.208 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2024-04-16T13:13:22.223 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2024-04-16T13:13:22.223 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts
2024-04-16T13:13:22.278 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2024-04-16T13:13:22.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2024-04-16T13:13:22.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts
2024-04-16T13:13:22.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2024-04-16T13:13:22.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname
2024-04-16T13:13:22.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2024-04-16T13:13:22.634 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2024-04-16T13:13:22.688 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2024-04-16T13:13:22.688 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9"
2024-04-16T13:13:22.688 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2024-04-16T13:13:22.688 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2024-04-16T13:13:22.688 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T13:13:22.689 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T13:13:22.690 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2024-04-16T13:13:22.692 DEBUG:teuthology.parallel:result is None
2024-04-16T13:13:24.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:13:24.649 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T13:13:24.649 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T13:13:24.964 INFO:teuthology.provision.fog.smithi171:Node is ready
2024-04-16T13:13:24.964 DEBUG:teuthology.orchestra.run.smithi171:> hostname
2024-04-16T13:13:24.979 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2024-04-16T13:13:24.979 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts
2024-04-16T13:13:25.035 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2024-04-16T13:13:25.036 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-04-16T13:13:25.151 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts
2024-04-16T13:13:25.178 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts
2024-04-16T13:13:25.245 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname
2024-04-16T13:13:25.312 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-04-16T13:13:25.378 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-04-16T13:13:25.432 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T13:13:25.433 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T13:13:25.434 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T13:13:25.434 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2024-04-16T13:13:25.434 DEBUG:teuthology.parallel:result is None
2024-04-16T13:13:54.779 WARNING:teuthology.provision.fog.smithi151:timed out
2024-04-16T13:14:00.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:14:01.100 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T13:14:01.100 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T13:14:01.431 INFO:teuthology.provision.fog.smithi151:Node is ready
2024-04-16T13:14:01.432 DEBUG:teuthology.orchestra.run.smithi151:> hostname
2024-04-16T13:14:01.445 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com
2024-04-16T13:14:01.446 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts
2024-04-16T13:14:01.504 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151
2024-04-16T13:14:01.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2024-04-16T13:14:01.614 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts
2024-04-16T13:14:01.641 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts
2024-04-16T13:14:01.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname
2024-04-16T13:14:01.784 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2024-04-16T13:14:01.854 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/"
2024-04-16T13:14:01.913 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T13:14:01.914 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T13:14:01.914 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T13:14:01.914 INFO:teuthology.provision.fog.smithi151:Deploy complete!
2024-04-16T13:14:01.915 DEBUG:teuthology.parallel:result is None
2024-04-16T13:14:02.136 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2024-04-16T13:14:02.137 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-16T13:14:02.155 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com
2024-04-16T13:14:02.156 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-16T13:14:02.172 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2024-04-16T13:14:02.172 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-16T13:14:02.190 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2024-04-16T13:14:02.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2024-04-16T13:14:02.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:14:02.279 DEBUG:teuthology.orchestra.run.smithi081:> true
2024-04-16T13:14:02.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2024-04-16T13:14:02.449 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2024-04-16T13:14:02.504 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2024-04-16T13:14:02.504 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T13:14:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2024-04-16T13:14:02.560 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T13:14:02.560 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T13:14:02.560 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T13:14:02.560 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2024-04-16T13:14:02.581 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server
2024-04-16T13:14:02.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com'
2024-04-16T13:14:02.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:14:02.667 DEBUG:teuthology.orchestra.run.smithi151:> true
2024-04-16T13:14:02.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com'
2024-04-16T13:14:02.736 DEBUG:teuthology.orchestra.run.smithi151:> uname -m
2024-04-16T13:14:02.789 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64
2024-04-16T13:14:02.789 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2024-04-16T13:14:02.843 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream"
2024-04-16T13:14:02.843 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9"
2024-04-16T13:14:02.843 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos"
2024-04-16T13:14:02.843 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T13:14:02.844 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T13:14:02.845 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2024-04-16T13:14:02.863 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2024-04-16T13:14:02.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-04-16T13:14:02.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T13:14:02.953 DEBUG:teuthology.orchestra.run.smithi171:> true
2024-04-16T13:14:03.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-04-16T13:14:03.120 DEBUG:teuthology.orchestra.run.smithi171:> uname -m
2024-04-16T13:14:03.175 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2024-04-16T13:14:03.175 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-04-16T13:14:03.230 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-04-16T13:14:03.231 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T13:14:03.231 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-04-16T13:14:03.231 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T13:14:03.231 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T13:14:03.231 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T13:14:03.231 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-04-16T13:14:03.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:14:03.353 INFO:teuthology.dispatcher.supervisor:Running job 7658341
2024-04-16T13:14:03.354 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-04-16_13:02:43-fs-wip-mchangir-qa-debug-resource-temporarily-unavailable-issue-distro-default-smithi/7658341 --name mchangir-2024-04-16_13:02:43-fs-wip-mchangir-qa-debug-resource-temporarily-unavailable-issue-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/mchangir-2024-04-16_13:02:43-fs-wip-mchangir-qa-debug-resource-temporarily-unavailable-issue-distro-default-smithi/7658341/orig.config.yaml
2024-04-16T13:14:03.357 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-04-16_13:02:43-fs-wip-mchangir-qa-debug-resource-temporarily-unavailable-issue-distro-default-smithi/7658341
2024-04-16T13:14:03.357 INFO:teuthology.dispatcher.supervisor:Job PID: 4125443
2024-04-16T13:14:03.357 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-16T13:16:03.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:18:03.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:20:03.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:22:03.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:24:04.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:26:04.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:28:04.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:30:04.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:32:04.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:34:04.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:36:05.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:38:05.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:40:05.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:42:05.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:44:05.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:46:06.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:48:06.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:50:06.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:52:06.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:54:06.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:56:07.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T13:56:07.067 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1