2024-03-01T18:36:10.298 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-03-01T18:36:10.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:36:10.469 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f732b463f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f732c4c4c10>, signals=[15])
2024-03-01T18:36:10.469 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2024-03-01T18:36:10.470 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T18:36:10.470 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-03-01T18:36:10.492 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging
2024-03-01T18:36:10.492 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T18:36:10.492 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-03-01T18:36:10.517 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2024-03-01T18:36:10.517 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T18:36:10.517 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-03-01T18:36:10.625 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T18:36:10.629 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T18:36:10.666 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T18:36:10.678 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 9.stream
2024-03-01T18:36:10.687 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 9.stream
2024-03-01T18:36:10.723 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream
2024-03-01T18:36:11.016 INFO:teuthology.orchestra.console.smithi171:Power off
2024-03-01T18:36:11.017 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T18:36:11.038 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off
2024-03-01T18:36:11.038 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:11.059 INFO:teuthology.orchestra.console.smithi032:Power off
2024-03-01T18:36:11.060 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T18:36:11.074 INFO:teuthology.orchestra.console.smithi196:Power off
2024-03-01T18:36:11.074 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T18:36:11.081 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-03-01T18:36:11.083 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2024-03-01T18:36:11.084 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:11.097 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-03-01T18:36:11.097 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:11.109 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-01T18:36:11.120 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-03-01T18:36:11.183 INFO:teuthology.orchestra.console.smithi171:Power off completed
2024-03-01T18:36:11.284 INFO:teuthology.orchestra.console.smithi171:Power on
2024-03-01T18:36:11.284 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T18:36:11.310 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On
2024-03-01T18:36:11.310 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:11.331 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-03-01T18:36:15.112 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:15.121 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:15.223 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-01T18:36:15.231 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-03-01T18:36:15.332 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:15.441 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off
2024-03-01T18:36:19.224 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:19.232 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:19.333 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-01T18:36:19.340 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-03-01T18:36:19.442 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:19.551 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on
2024-03-01T18:36:19.651 INFO:teuthology.orchestra.console.smithi171:Power on completed
2024-03-01T18:36:19.752 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2024-03-01T18:36:23.336 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:23.343 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:23.445 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-01T18:36:23.452 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-03-01T18:36:23.546 INFO:teuthology.orchestra.console.smithi032:Power off completed
2024-03-01T18:36:23.553 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-03-01T18:36:23.647 INFO:teuthology.orchestra.console.smithi032:Power on
2024-03-01T18:36:23.647 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T18:36:23.655 INFO:teuthology.orchestra.console.smithi196:Power on
2024-03-01T18:36:23.655 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T18:36:23.669 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On
2024-03-01T18:36:23.669 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:23.677 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2024-03-01T18:36:23.678 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:23.690 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-01T18:36:23.698 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-03-01T18:36:27.691 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:27.699 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:27.801 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-01T18:36:27.807 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-03-01T18:36:27.903 INFO:teuthology.orchestra.console.smithi032:Power on completed
2024-03-01T18:36:28.003 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2024-03-01T18:36:31.809 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:36:31.918 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-03-01T18:36:32.018 INFO:teuthology.orchestra.console.smithi196:Power on completed
2024-03-01T18:36:32.119 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2024-03-01T18:38:43.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:38:46.748 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-01T18:38:52.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:38:55.804 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-01T18:39:01.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:04.860 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-01T18:39:05.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:08.572 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-01T18:39:10.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:13.916 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-01T18:39:14.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:17.628 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-01T18:39:17.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:19.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:20.924 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-01T18:39:22.976 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-01T18:39:23.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:26.688 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-01T18:39:26.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:28.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:29.980 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-01T18:39:32.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:35.772 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-01T18:39:35.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:39.040 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-01T18:39:41.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:44.864 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-01T18:39:45.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:48.092 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-01T18:39:50.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:53.948 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2024-03-01T18:39:54.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:39:57.152 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-01T18:39:59.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:40:03.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:40:06.236 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-03-01T18:40:12.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:40:29.001 WARNING:teuthology.provision.fog.smithi032:timed out
2024-03-01T18:40:35.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:40:35.252 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T18:40:35.253 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T18:40:35.590 INFO:teuthology.provision.fog.smithi032:Node is ready
2024-03-01T18:40:35.590 DEBUG:teuthology.orchestra.run.smithi032:> hostname
2024-03-01T18:40:35.605 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2024-03-01T18:40:35.606 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts
2024-03-01T18:40:35.662 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2024-03-01T18:40:35.662 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-03-01T18:40:35.776 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts
2024-03-01T18:40:35.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts
2024-03-01T18:40:35.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname
2024-03-01T18:40:35.951 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-03-01T18:40:36.021 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-03-01T18:40:36.075 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:40:36.076 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:40:36.077 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:40:36.077 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2024-03-01T18:40:36.078 DEBUG:teuthology.parallel:result is None
2024-03-01T18:40:59.968 WARNING:teuthology.provision.fog.smithi171:timed out
2024-03-01T18:41:05.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:41:06.188 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T18:41:06.188 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T18:41:06.511 INFO:teuthology.provision.fog.smithi171:Node is ready
2024-03-01T18:41:06.511 DEBUG:teuthology.orchestra.run.smithi171:> hostname
2024-03-01T18:41:06.526 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2024-03-01T18:41:06.526 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts
2024-03-01T18:41:06.582 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2024-03-01T18:41:06.582 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-03-01T18:41:06.690 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts
2024-03-01T18:41:06.718 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts
2024-03-01T18:41:06.785 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname
2024-03-01T18:41:06.853 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2024-03-01T18:41:06.919 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-03-01T18:41:06.973 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:41:06.974 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:41:06.975 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2024-03-01T18:41:06.975 DEBUG:teuthology.parallel:result is None
2024-03-01T18:41:12.247 WARNING:teuthology.provision.fog.smithi196:timed out
2024-03-01T18:41:18.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:41:18.489 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T18:41:18.489 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T18:41:18.794 INFO:teuthology.provision.fog.smithi196:Node is ready
2024-03-01T18:41:18.795 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2024-03-01T18:41:18.808 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2024-03-01T18:41:18.809 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2024-03-01T18:41:18.864 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2024-03-01T18:41:18.864 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-03-01T18:41:18.969 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2024-03-01T18:41:18.996 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2024-03-01T18:41:19.064 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2024-03-01T18:41:19.131 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-03-01T18:41:19.198 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-03-01T18:41:19.252 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2024-03-01T18:41:19.252 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2024-03-01T18:41:19.252 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2024-03-01T18:41:19.252 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:41:19.252 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2024-03-01T18:41:19.252 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:41:19.252 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:41:19.253 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-03-01T18:41:19.253 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:41:19.253 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:41:19.253 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:41:19.253 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:41:19.253 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:41:19.253 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:41:19.253 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2024-03-01T18:41:19.254 DEBUG:teuthology.parallel:result is None
2024-03-01T18:41:19.473 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2024-03-01T18:41:19.473 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T18:41:19.497 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2024-03-01T18:41:19.497 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T18:41:19.514 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2024-03-01T18:41:19.514 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T18:41:19.531 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2024-03-01T18:41:19.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-03-01T18:41:19.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:41:19.635 DEBUG:teuthology.orchestra.run.smithi032:> true
2024-03-01T18:41:19.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-03-01T18:41:19.815 DEBUG:teuthology.orchestra.run.smithi032:> uname -m
2024-03-01T18:41:19.870 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2024-03-01T18:41:19.871 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-03-01T18:41:19.925 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2024-03-01T18:41:19.925 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:41:19.926 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:41:19.927 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-03-01T18:41:19.947 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2024-03-01T18:41:19.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-01T18:41:19.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:41:20.040 DEBUG:teuthology.orchestra.run.smithi171:> true
2024-03-01T18:41:20.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com'
2024-03-01T18:41:20.164 DEBUG:teuthology.orchestra.run.smithi171:> uname -m
2024-03-01T18:41:20.218 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2024-03-01T18:41:20.219 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2024-03-01T18:41:20.272 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2024-03-01T18:41:20.272 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:41:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:41:20.274 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2024-03-01T18:41:20.297 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2024-03-01T18:41:20.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-03-01T18:41:20.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:41:20.385 DEBUG:teuthology.orchestra.run.smithi196:> true
2024-03-01T18:41:20.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-03-01T18:41:20.451 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2024-03-01T18:41:20.506 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2024-03-01T18:41:20.506 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:41:20.561 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:41:20.562 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:41:20.562 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:41:20.562 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:41:20.562 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:41:20.562 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-03-01T18:41:20.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:41:20.694 INFO:teuthology.dispatcher.supervisor:Running job 7577715
2024-03-01T18:41:20.694 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577715 --name rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577715/orig.config.yaml
2024-03-01T18:41:20.698 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577715
2024-03-01T18:41:20.698 INFO:teuthology.dispatcher.supervisor:Job PID: 2545028
2024-03-01T18:41:20.698 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-01T18:43:20.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:45:20.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:47:21.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:49:21.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:51:21.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:53:21.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:55:21.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:57:22.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:59:22.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:01:22.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:03:22.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:05:22.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:07:22.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:09:23.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:11:23.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:13:23.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:15:23.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:17:23.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:19:23.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:21:24.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:23:24.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:25:24.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:25:24.424 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1