2024-04-17T14:39:44.278 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-17T14:39:44.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:39:44.457 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7a6ff85f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7a70fe6c10>, signals=[15])
2024-04-17T14:39:44.458 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging
2024-04-17T14:39:44.458 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:44.458 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2024-04-17T14:39:44.473 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging
2024-04-17T14:39:44.473 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:44.473 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2024-04-17T14:39:44.498 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2024-04-17T14:39:44.498 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:44.498 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-04-17T14:39:44.577 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:44.597 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:44.623 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 9.stream
2024-04-17T14:39:44.631 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:44.642 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream
2024-04-17T14:39:44.673 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream
2024-04-17T14:39:44.901 INFO:teuthology.orchestra.console.smithi018:Power off
2024-04-17T14:39:44.902 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:39:44.925 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off
2024-04-17T14:39:44.925 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:44.941 INFO:teuthology.orchestra.console.smithi019:Power off
2024-04-17T14:39:44.941 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:39:44.949 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2024-04-17T14:39:44.955 INFO:teuthology.orchestra.console.smithi156:Power off
2024-04-17T14:39:44.955 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:39:44.963 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2024-04-17T14:39:44.963 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:44.974 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-04-17T14:39:44.975 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:44.983 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-04-17T14:39:44.993 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-17T14:39:45.050 INFO:teuthology.orchestra.console.smithi018:Power off completed
2024-04-17T14:39:45.084 INFO:teuthology.orchestra.console.smithi019:Power off completed
2024-04-17T14:39:45.093 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-04-17T14:39:45.152 INFO:teuthology.orchestra.console.smithi018:Power on
2024-04-17T14:39:45.152 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:39:45.173 DEBUG:teuthology.orchestra.console.smithi018:power on output: Chassis Power Control: Up/On
2024-04-17T14:39:45.174 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:45.185 INFO:teuthology.orchestra.console.smithi019:Power on
2024-04-17T14:39:45.185 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:39:45.194 INFO:teuthology.orchestra.console.smithi156:Power on
2024-04-17T14:39:45.195 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:39:45.201 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2024-04-17T14:39:45.205 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On
2024-04-17T14:39:45.205 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:45.215 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2024-04-17T14:39:45.216 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:45.225 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-04-17T14:39:45.236 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-17T14:39:49.206 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:49.226 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:49.237 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:49.315 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on
2024-04-17T14:39:49.335 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-04-17T14:39:49.347 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-17T14:39:49.416 INFO:teuthology.orchestra.console.smithi018:Power on completed
2024-04-17T14:39:49.516 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish
2024-04-17T14:39:53.338 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:53.348 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:53.448 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-04-17T14:39:53.456 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-04-17T14:39:53.549 INFO:teuthology.orchestra.console.smithi019:Power on completed
2024-04-17T14:39:53.556 INFO:teuthology.orchestra.console.smithi156:Power on completed
2024-04-17T14:39:53.650 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2024-04-17T14:39:53.657 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2024-04-17T14:42:22.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:42:25.854 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T14:42:26.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:42:29.342 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-17T14:42:31.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:42:34.910 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T14:42:35.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:42:38.402 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-17T14:42:40.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:42:43.966 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T14:42:44.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:42:47.454 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-17T14:42:49.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:42:53.022 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T14:42:53.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:42:56.510 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-17T14:42:59.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:02.078 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T14:43:02.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:05.566 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-17T14:43:08.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:11.134 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T14:43:11.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:17.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:27.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:30.206 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-17T14:43:36.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:39.262 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-17T14:43:45.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:48.318 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-17T14:43:54.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:57.406 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-17T14:44:03.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:06.462 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-17T14:44:11.574 WARNING:teuthology.provision.fog.smithi019:timed out
2024-04-17T14:44:12.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:15.518 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-17T14:44:17.144 WARNING:teuthology.provision.fog.smithi018:timed out
2024-04-17T14:44:17.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:17.817 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:44:17.817 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:44:18.133 INFO:teuthology.provision.fog.smithi019:Node is ready
2024-04-17T14:44:18.133 DEBUG:teuthology.orchestra.run.smithi019:> hostname
2024-04-17T14:44:18.148 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com
2024-04-17T14:44:18.148 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts
2024-04-17T14:44:18.203 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019
2024-04-17T14:44:18.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2024-04-17T14:44:18.302 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts
2024-04-17T14:44:18.334 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts
2024-04-17T14:44:18.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname
2024-04-17T14:44:18.476 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2024-04-17T14:44:18.546 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:44:18.601 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:44:18.602 INFO:teuthology.provision.fog.smithi019:Deploy complete!
2024-04-17T14:44:18.603 DEBUG:teuthology.parallel:result is None
2024-04-17T14:44:21.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:23.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:23.414 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:44:23.415 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:44:23.748 INFO:teuthology.provision.fog.smithi018:Node is ready
2024-04-17T14:44:23.748 DEBUG:teuthology.orchestra.run.smithi018:> hostname
2024-04-17T14:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com
2024-04-17T14:44:23.763 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts
2024-04-17T14:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018
2024-04-17T14:44:23.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018
2024-04-17T14:44:23.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts
2024-04-17T14:44:23.955 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts
2024-04-17T14:44:24.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname
2024-04-17T14:44:24.097 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018
2024-04-17T14:44:24.167 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream"
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9"
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9"
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2024-04-17T14:44:24.222 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:44:24.223 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:44:24.223 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:44:24.223 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:44:24.223 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:44:24.223 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:44:24.223 INFO:teuthology.provision.fog.smithi018:Deploy complete!
2024-04-17T14:44:24.224 DEBUG:teuthology.parallel:result is None
2024-04-17T14:44:24.574 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-17T14:44:30.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:30.643 WARNING:teuthology.provision.fog.smithi156:timed out
2024-04-17T14:45:36.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:36.968 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:45:36.969 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:45:37.282 INFO:teuthology.provision.fog.smithi156:Node is ready
2024-04-17T14:45:37.282 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2024-04-17T14:45:37.296 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2024-04-17T14:45:37.297 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2024-04-17T14:45:37.352 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2024-04-17T14:45:37.352 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-04-17T14:45:37.461 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2024-04-17T14:45:37.489 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2024-04-17T14:45:37.556 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2024-04-17T14:45:37.623 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-04-17T14:45:37.689 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:45:37.744 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:45:37.745 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:45:37.745 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:45:37.745 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2024-04-17T14:45:37.745 DEBUG:teuthology.parallel:result is None
2024-04-17T14:45:37.963 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com
2024-04-17T14:45:37.963 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:45:37.985 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com
2024-04-17T14:45:37.985 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:45:38.001 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2024-04-17T14:45:38.001 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:45:38.019 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:45:38.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com'
2024-04-17T14:45:38.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:38.122 DEBUG:teuthology.orchestra.run.smithi018:> true
2024-04-17T14:45:38.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com'
2024-04-17T14:45:38.301 DEBUG:teuthology.orchestra.run.smithi018:> uname -m
2024-04-17T14:45:38.356 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64
2024-04-17T14:45:38.356 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release
2024-04-17T14:45:38.411 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream"
2024-04-17T14:45:38.411 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9"
2024-04-17T14:45:38.411 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2024-04-17T14:45:38.411 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:45:38.411 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:45:38.412 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:45:38.412 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2024-04-17T14:45:38.468 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:45:38.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2024-04-17T14:45:38.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:38.569 DEBUG:teuthology.orchestra.run.smithi019:> true
2024-04-17T14:45:38.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com'
2024-04-17T14:45:38.748 DEBUG:teuthology.orchestra.run.smithi019:> uname -m
2024-04-17T14:45:38.803 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64
2024-04-17T14:45:38.803 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:45:38.858 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:45:38.859 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:45:38.859 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:45:38.859 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:45:38.859 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2024-04-17T14:45:38.876 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:45:38.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-04-17T14:45:38.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:38.963 DEBUG:teuthology.orchestra.run.smithi156:> true
2024-04-17T14:45:39.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-04-17T14:45:39.034 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2024-04-17T14:45:39.095 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2024-04-17T14:45:39.095 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-04-17T14:45:39.154 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-04-17T14:45:39.154 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-04-17T14:45:39.154 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-04-17T14:45:39.154 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:45:39.154 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-04-17T14:45:39.154 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:45:39.155 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:45:39.155 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-04-17T14:45:39.155 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:45:39.155 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:45:39.155 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:45:39.155 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:45:39.157 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:45:39.157 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:45:39.157 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-04-17T14:45:39.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:45:39.287 INFO:teuthology.dispatcher.supervisor:Running job 7660342
2024-04-17T14:45:39.287 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660342 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660342/orig.config.yaml
2024-04-17T14:45:39.290 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660342
2024-04-17T14:45:39.290 INFO:teuthology.dispatcher.supervisor:Job PID: 1514322
2024-04-17T14:45:39.291 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T14:47:39.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:49:39.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:51:39.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:53:39.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:53:39.971 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1