2024-04-17T14:39:59.598 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-17T14:39:59.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:39:59.784 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9fe7da8f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9fe8ddfc10>, signals=[15])
2024-04-17T14:39:59.785 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging
2024-04-17T14:39:59.785 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:59.785 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2024-04-17T14:39:59.807 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging
2024-04-17T14:39:59.807 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:59.807 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2024-04-17T14:39:59.831 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2024-04-17T14:39:59.832 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:59.832 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2024-04-17T14:39:59.921 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:59.932 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:59.957 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 9.stream
2024-04-17T14:39:59.965 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 9.stream
2024-04-17T14:39:59.968 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:40:00.020 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream
2024-04-17T14:40:00.644 INFO:teuthology.orchestra.console.smithi049:Power off
2024-04-17T14:40:00.644 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:40:00.665 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2024-04-17T14:40:00.665 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:00.689 INFO:teuthology.orchestra.console.smithi080:Power off
2024-04-17T14:40:00.689 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:40:00.697 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-04-17T14:40:00.709 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off
2024-04-17T14:40:00.709 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:00.729 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2024-04-17T14:40:00.783 INFO:teuthology.orchestra.console.smithi115:Power off
2024-04-17T14:40:00.783 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:40:00.798 INFO:teuthology.orchestra.console.smithi049:Power off completed
2024-04-17T14:40:00.803 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2024-04-17T14:40:00.803 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:00.822 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2024-04-17T14:40:00.830 INFO:teuthology.orchestra.console.smithi080:Power off completed
2024-04-17T14:40:00.899 INFO:teuthology.orchestra.console.smithi049:Power on
2024-04-17T14:40:00.900 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:40:00.920 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On
2024-04-17T14:40:00.920 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:00.926 INFO:teuthology.orchestra.console.smithi115:Power off completed
2024-04-17T14:40:00.931 INFO:teuthology.orchestra.console.smithi080:Power on
2024-04-17T14:40:00.931 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:40:00.940 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-04-17T14:40:00.950 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On
2024-04-17T14:40:00.951 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:00.970 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2024-04-17T14:40:01.027 INFO:teuthology.orchestra.console.smithi115:Power on
2024-04-17T14:40:01.027 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:40:01.047 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On
2024-04-17T14:40:01.047 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:01.067 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2024-04-17T14:40:04.945 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:04.971 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:05.055 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-04-17T14:40:05.068 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:05.080 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2024-04-17T14:40:05.177 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2024-04-17T14:40:05.277 INFO:teuthology.orchestra.console.smithi115:Power on completed
2024-04-17T14:40:05.378 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2024-04-17T14:40:09.057 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:09.081 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:09.167 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2024-04-17T14:40:09.188 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2024-04-17T14:40:09.268 INFO:teuthology.orchestra.console.smithi049:Power on completed
2024-04-17T14:40:09.289 INFO:teuthology.orchestra.console.smithi080:Power on completed
2024-04-17T14:40:09.369 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2024-04-17T14:40:09.390 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish
2024-04-17T14:45:10.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:13.888 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-04-17T14:45:14.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:17.118 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:45:19.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:22.974 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-04-17T14:45:23.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:26.174 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:45:28.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:32.030 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-04-17T14:45:32.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:35.234 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:45:38.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:41.087 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-04-17T14:45:41.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:44.286 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:45:47.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:50.142 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-04-17T14:45:50.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:53.342 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:45:56.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:59.198 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-04-17T14:45:59.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:02.398 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:46:05.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:08.254 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2024-04-17T14:46:08.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:11.454 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:46:14.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:14.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:17.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:17.694 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-04-17T14:46:20.510 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:46:23.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:26.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:26.750 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-04-17T14:46:29.566 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:46:32.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:35.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:35.806 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-04-17T14:46:38.622 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-04-17T14:46:41.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:44.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:44.862 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-04-17T14:46:50.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:53.950 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-04-17T14:46:59.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:03.006 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-04-17T14:47:09.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:14.262 WARNING:teuthology.provision.fog.smithi115:timed out
2024-04-17T14:47:20.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:20.462 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:47:20.462 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:47:20.787 INFO:teuthology.provision.fog.smithi115:Node is ready
2024-04-17T14:47:20.787 DEBUG:teuthology.orchestra.run.smithi115:> hostname
2024-04-17T14:47:20.801 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2024-04-17T14:47:20.802 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts
2024-04-17T14:47:20.857 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2024-04-17T14:47:20.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2024-04-17T14:47:20.988 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts
2024-04-17T14:47:21.016 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts
2024-04-17T14:47:21.085 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname
2024-04-17T14:47:21.152 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2024-04-17T14:47:21.219 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2024-04-17T14:47:21.274 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2024-04-17T14:47:21.274 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9"
2024-04-17T14:47:21.274 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:47:21.275 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:47:21.276 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2024-04-17T14:47:21.277 DEBUG:teuthology.parallel:result is None
2024-04-17T14:47:44.650 WARNING:teuthology.provision.fog.smithi049:timed out
2024-04-17T14:47:50.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:50.962 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:47:50.962 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:47:51.357 INFO:teuthology.provision.fog.smithi049:Node is ready
2024-04-17T14:47:51.357 DEBUG:teuthology.orchestra.run.smithi049:> hostname
2024-04-17T14:47:51.373 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2024-04-17T14:47:51.373 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts
2024-04-17T14:47:51.429 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2024-04-17T14:47:51.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2024-04-17T14:47:51.553 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts
2024-04-17T14:47:51.586 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts
2024-04-17T14:47:51.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname
2024-04-17T14:47:51.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2024-04-17T14:47:51.801 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2024-04-17T14:47:51.856 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2024-04-17T14:47:51.856 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9"
2024-04-17T14:47:51.856 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2024-04-17T14:47:51.856 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:47:51.856 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:47:51.857 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:47:51.857 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2024-04-17T14:47:51.858 DEBUG:teuthology.parallel:result is None
2024-04-17T14:48:09.023 WARNING:teuthology.provision.fog.smithi080:timed out
2024-04-17T14:48:15.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:48:15.372 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:48:15.372 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:48:15.710 INFO:teuthology.provision.fog.smithi080:Node is ready
2024-04-17T14:48:15.710 DEBUG:teuthology.orchestra.run.smithi080:> hostname
2024-04-17T14:48:15.724 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com
2024-04-17T14:48:15.724 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts
2024-04-17T14:48:15.780 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080
2024-04-17T14:48:15.780 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080
2024-04-17T14:48:15.896 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts
2024-04-17T14:48:15.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts
2024-04-17T14:48:15.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname
2024-04-17T14:48:16.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080
2024-04-17T14:48:16.122 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream"
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9"
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos"
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9"
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2024-04-17T14:48:16.177 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:48:16.178 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:48:16.178 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:48:16.178 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:48:16.178 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:48:16.178 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:48:16.178 INFO:teuthology.provision.fog.smithi080:Deploy complete!
2024-04-17T14:48:16.179 DEBUG:teuthology.parallel:result is None
2024-04-17T14:48:16.388 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2024-04-17T14:48:16.388 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:48:16.408 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com
2024-04-17T14:48:16.408 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:48:16.425 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2024-04-17T14:48:16.425 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:48:16.443 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:48:16.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2024-04-17T14:48:16.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:48:16.546 DEBUG:teuthology.orchestra.run.smithi049:> true
2024-04-17T14:48:16.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com'
2024-04-17T14:48:16.729 DEBUG:teuthology.orchestra.run.smithi049:> uname -m
2024-04-17T14:48:16.784 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2024-04-17T14:48:16.784 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2024-04-17T14:48:16.840 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2024-04-17T14:48:16.840 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9"
2024-04-17T14:48:16.840 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2024-04-17T14:48:16.840 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:48:16.841 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:48:16.842 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2024-04-17T14:48:16.876 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:48:16.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com'
2024-04-17T14:48:16.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:48:16.961 DEBUG:teuthology.orchestra.run.smithi080:> true
2024-04-17T14:48:17.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com'
2024-04-17T14:48:17.029 DEBUG:teuthology.orchestra.run.smithi080:> uname -m
2024-04-17T14:48:17.084 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64
2024-04-17T14:48:17.084 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:48:17.139 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:48:17.140 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:48:17.140 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2024-04-17T14:48:17.167 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:48:17.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2024-04-17T14:48:17.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:48:17.255 DEBUG:teuthology.orchestra.run.smithi115:> true
2024-04-17T14:48:17.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com'
2024-04-17T14:48:17.429 DEBUG:teuthology.orchestra.run.smithi115:> uname -m
2024-04-17T14:48:17.483 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2024-04-17T14:48:17.483 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2024-04-17T14:48:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2024-04-17T14:48:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9"
2024-04-17T14:48:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2024-04-17T14:48:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:48:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9"
2024-04-17T14:48:17.538 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:48:17.539 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:48:17.539 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2024-04-17T14:48:17.539 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:48:17.539 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:48:17.539 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:48:17.539 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:48:17.539 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:48:17.539 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:48:17.539 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2024-04-17T14:48:17.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:48:17.663 INFO:teuthology.dispatcher.supervisor:Running job 7660400
2024-04-17T14:48:17.663 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660400 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660400/orig.config.yaml
2024-04-17T14:48:17.666 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660400
2024-04-17T14:48:17.666 INFO:teuthology.dispatcher.supervisor:Job PID: 1517040
2024-04-17T14:48:17.666 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T14:50:17.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:52:17.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:54:18.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:56:18.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:58:18.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:58:18.568 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1