2024-04-17T09:00:17.539 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-17T09:00:17.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T09:00:17.722 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9607918f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9608978c10>, signals=[15])
2024-04-17T09:00:17.723 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging
2024-04-17T09:00:17.723 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T09:00:17.723 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2024-04-17T09:00:17.743 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2024-04-17T09:00:17.744 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T09:00:17.744 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-17T09:00:17.767 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2024-04-17T09:00:17.768 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T09:00:17.768 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-04-17T09:00:17.862 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T09:00:17.876 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T09:00:17.910 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T09:00:17.913 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 9.stream
2024-04-17T09:00:17.917 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 9.stream
2024-04-17T09:00:17.962 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 9.stream
2024-04-17T09:00:18.184 INFO:teuthology.orchestra.console.smithi027:Power off
2024-04-17T09:00:18.184 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T09:00:18.198 INFO:teuthology.orchestra.console.smithi018:Power off
2024-04-17T09:00:18.198 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T09:00:18.211 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-04-17T09:00:18.212 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:18.222 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off
2024-04-17T09:00:18.222 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:18.234 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-17T09:00:18.244 INFO:teuthology.orchestra.console.smithi153:Power off
2024-04-17T09:00:18.244 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T09:00:18.253 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2024-04-17T09:00:18.265 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-04-17T09:00:18.265 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:18.286 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-04-17T09:00:18.336 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-04-17T09:00:18.354 INFO:teuthology.orchestra.console.smithi018:Power off completed
2024-04-17T09:00:18.387 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-04-17T09:00:18.437 INFO:teuthology.orchestra.console.smithi027:Power on
2024-04-17T09:00:18.437 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T09:00:18.455 INFO:teuthology.orchestra.console.smithi018:Power on
2024-04-17T09:00:18.455 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T09:00:18.464 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2024-04-17T09:00:18.464 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:18.476 DEBUG:teuthology.orchestra.console.smithi018:power on output: Chassis Power Control: Up/On
2024-04-17T09:00:18.477 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:18.484 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-17T09:00:18.489 INFO:teuthology.orchestra.console.smithi153:Power on
2024-04-17T09:00:18.489 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T09:00:18.501 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off
2024-04-17T09:00:18.514 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2024-04-17T09:00:18.515 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:18.537 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-04-17T09:00:22.486 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:22.502 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:22.538 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T09:00:22.596 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-17T09:00:22.611 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on
2024-04-17T09:00:22.646 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-04-17T09:00:22.697 INFO:teuthology.orchestra.console.smithi027:Power on completed
2024-04-17T09:00:22.712 INFO:teuthology.orchestra.console.smithi018:Power on completed
2024-04-17T09:00:22.747 INFO:teuthology.orchestra.console.smithi153:Power on completed
2024-04-17T09:00:22.799 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2024-04-17T09:00:22.813 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish
2024-04-17T09:00:22.848 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2024-04-17T09:02:54.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:02:57.214 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:03:03.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:03:06.302 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:03:12.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:03:15.362 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:03:21.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:03:24.446 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:03:30.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:03:33.538 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:03:39.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:03:42.590 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:03:48.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:03:51.646 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:03:54.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:03:54.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:03:57.470 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:03:57.471 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-04-17T09:03:57.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:00.702 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:04:03.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:03.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:06.526 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:04:06.527 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-04-17T09:04:06.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:09.758 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:04:12.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:12.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:15.586 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:04:15.587 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-04-17T09:04:15.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:18.814 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18
2024-04-17T09:04:21.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:21.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:24.670 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-04-17T09:04:24.671 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:04:24.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:30.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:30.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:33.726 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-04-17T09:04:33.729 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:04:39.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:39.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:42.814 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-04-17T09:04:42.815 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:04:48.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:48.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:51.902 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-04-17T09:04:51.903 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:04:57.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:04:57.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:05:00.990 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:05:06.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:05:10.046 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:05:16.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:05:19.134 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:05:24.822 WARNING:teuthology.provision.fog.smithi018:timed out
2024-04-17T09:05:25.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:05:30.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:05:31.092 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T09:05:31.092 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T09:05:31.441 INFO:teuthology.provision.fog.smithi018:Node is ready
2024-04-17T09:05:31.442 DEBUG:teuthology.orchestra.run.smithi018:> hostname
2024-04-17T09:05:31.456 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com
2024-04-17T09:05:31.457 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts
2024-04-17T09:05:31.512 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018
2024-04-17T09:05:31.513 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018
2024-04-17T09:05:31.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts
2024-04-17T09:05:31.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts
2024-04-17T09:05:31.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname
2024-04-17T09:05:31.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018
2024-04-17T09:05:31.860 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release
2024-04-17T09:05:31.915 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream"
2024-04-17T09:05:31.915 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9"
2024-04-17T09:05:31.915 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2024-04-17T09:05:31.915 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2024-04-17T09:05:31.915 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T09:05:31.916 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T09:05:31.917 INFO:teuthology.provision.fog.smithi018:Deploy complete!
2024-04-17T09:05:31.918 DEBUG:teuthology.parallel:result is None
2024-04-17T09:05:43.454 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:05:49.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:05:52.514 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:05:57.912 WARNING:teuthology.provision.fog.smithi153:timed out
2024-04-17T09:05:58.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:06:01.598 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T09:06:03.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:06:04.163 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T09:06:04.163 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T09:06:04.479 INFO:teuthology.provision.fog.smithi153:Node is ready
2024-04-17T09:06:04.479 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2024-04-17T09:06:04.493 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2024-04-17T09:06:04.493 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2024-04-17T09:06:04.548 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2024-04-17T09:06:04.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-04-17T09:06:04.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2024-04-17T09:06:04.672 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2024-04-17T09:06:04.739 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2024-04-17T09:06:04.806 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-04-17T09:06:04.873 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-04-17T09:06:04.927 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2024-04-17T09:06:04.927 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9"
2024-04-17T09:06:04.927 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2024-04-17T09:06:04.927 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2024-04-17T09:06:04.927 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T09:06:04.928 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T09:06:04.928 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2024-04-17T09:06:04.929 DEBUG:teuthology.parallel:result is None
2024-04-17T09:06:07.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:06:07.871 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T09:06:07.871 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T09:06:23.094 INFO:teuthology.provision.fog.smithi027:Node is ready
2024-04-17T09:06:23.094 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2024-04-17T09:06:23.113 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2024-04-17T09:06:23.113 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2024-04-17T09:06:23.170 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2024-04-17T09:06:23.170 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-17T09:06:23.303 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2024-04-17T09:06:23.336 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2024-04-17T09:06:23.410 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2024-04-17T09:06:23.483 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-17T09:06:23.554 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-17T09:06:23.609 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-04-17T09:06:23.609 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9"
2024-04-17T09:06:23.609 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-04-17T09:06:23.609 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-04-17T09:06:23.609 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T09:06:23.610 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T09:06:23.610 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2024-04-17T09:06:23.611 DEBUG:teuthology.parallel:result is None
2024-04-17T09:06:23.860 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com
2024-04-17T09:06:23.860 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T09:06:23.883 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2024-04-17T09:06:23.883 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T09:06:23.907 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2024-04-17T09:06:23.907 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T09:06:23.924 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server
2024-04-17T09:06:23.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com'
2024-04-17T09:06:23.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:06:24.028 DEBUG:teuthology.orchestra.run.smithi018:> true
2024-04-17T09:06:24.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com'
2024-04-17T09:06:24.213 DEBUG:teuthology.orchestra.run.smithi018:> uname -m
2024-04-17T09:06:24.267 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64
2024-04-17T09:06:24.268 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release
2024-04-17T09:06:24.322 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T09:06:24.323 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T09:06:24.324 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2024-04-17T09:06:24.349 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2024-04-17T09:06:24.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-17T09:06:24.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:06:24.453 DEBUG:teuthology.orchestra.run.smithi027:> true
2024-04-17T09:06:24.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-17T09:06:24.522 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2024-04-17T09:06:24.579 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2024-04-17T09:06:24.579 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon"
2024-04-17T09:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T09:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-04-17T09:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T09:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T09:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T09:06:24.636 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-17T09:06:24.657 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2024-04-17T09:06:24.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-04-17T09:06:24.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T09:06:24.744 DEBUG:teuthology.orchestra.run.smithi153:> true
2024-04-17T09:06:24.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-04-17T09:06:24.917 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2024-04-17T09:06:24.971 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2024-04-17T09:06:24.971 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-04-17T09:06:25.026 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2024-04-17T09:06:25.026 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9"
2024-04-17T09:06:25.026 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2024-04-17T09:06:25.026 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2024-04-17T09:06:25.026 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9"
2024-04-17T09:06:25.026 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9"
2024-04-17T09:06:25.027 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T09:06:25.027 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-04-17T09:06:25.027 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon"
2024-04-17T09:06:25.027 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T09:06:25.027 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2024-04-17T09:06:25.027 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T09:06:25.027 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T09:06:25.027 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T09:06:25.027 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-04-17T09:06:25.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T09:06:25.149 INFO:teuthology.dispatcher.supervisor:Running job 7659989
2024-04-17T09:06:25.149 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659989 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659989/orig.config.yaml
2024-04-17T09:06:25.153 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659989
2024-04-17T09:06:25.153 INFO:teuthology.dispatcher.supervisor:Job PID: 541653
2024-04-17T09:06:25.153 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T09:08:25.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T09:10:25.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T09:12:25.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T09:14:25.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T09:16:25.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T09:16:25.997 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-04-17T09:16:26.164 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi018 but it was locked by another job: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660004
2024-04-17T09:16:26.164 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660003
2024-04-17T09:16:26.164 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi153 but it was locked by another job: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660005