2024-04-01T07:35:09.980 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-01T07:35:09.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:35:10.163 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3421c1af40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3422c7bc10>, signals=[15])
2024-04-01T07:35:10.164 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging
2024-04-01T07:35:10.164 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T07:35:10.164 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2024-04-01T07:35:10.183 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging
2024-04-01T07:35:10.183 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T07:35:10.184 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2024-04-01T07:35:10.208 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2024-04-01T07:35:10.208 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T07:35:10.208 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-04-01T07:35:10.313 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T07:35:10.324 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T07:35:10.340 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T07:35:10.365 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 9.stream
2024-04-01T07:35:10.372 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 9.stream
2024-04-01T07:35:10.395 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream
2024-04-01T07:35:10.786 INFO:teuthology.orchestra.console.smithi042:Power off
2024-04-01T07:35:10.786 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T07:35:10.799 INFO:teuthology.orchestra.console.smithi177:Power off
2024-04-01T07:35:10.800 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T07:35:10.811 INFO:teuthology.orchestra.console.smithi130:Power off
2024-04-01T07:35:10.812 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T07:35:10.821 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off
2024-04-01T07:35:10.821 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:10.827 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off
2024-04-01T07:35:10.828 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:10.836 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off
2024-04-01T07:35:10.836 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:10.845 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-04-01T07:35:10.852 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-01T07:35:10.858 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-04-01T07:35:14.849 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:14.857 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:14.864 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:14.960 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-04-01T07:35:14.966 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-01T07:35:14.972 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-04-01T07:35:18.962 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:18.969 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:18.975 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:19.071 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-04-01T07:35:19.077 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-01T07:35:19.084 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-04-01T07:35:19.178 INFO:teuthology.orchestra.console.smithi042:Power off completed
2024-04-01T07:35:19.279 INFO:teuthology.orchestra.console.smithi042:Power on
2024-04-01T07:35:19.279 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T07:35:19.300 DEBUG:teuthology.orchestra.console.smithi042:power on output: Chassis Power Control: Up/On
2024-04-01T07:35:19.300 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:19.321 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-01T07:35:23.077 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:23.085 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:23.186 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-04-01T07:35:23.193 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off
2024-04-01T07:35:23.287 INFO:teuthology.orchestra.console.smithi177:Power off completed
2024-04-01T07:35:23.294 INFO:teuthology.orchestra.console.smithi130:Power off completed
2024-04-01T07:35:23.322 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:23.388 INFO:teuthology.orchestra.console.smithi177:Power on
2024-04-01T07:35:23.389 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T07:35:23.396 INFO:teuthology.orchestra.console.smithi130:Power on
2024-04-01T07:35:23.396 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T07:35:23.410 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On
2024-04-01T07:35:23.411 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:23.419 DEBUG:teuthology.orchestra.console.smithi130:power on output: Chassis Power Control: Up/On
2024-04-01T07:35:23.419 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:23.430 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-04-01T07:35:23.431 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-04-01T07:35:23.440 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off
2024-04-01T07:35:27.434 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:27.441 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:27.446 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T07:35:27.543 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-04-01T07:35:27.548 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-04-01T07:35:27.555 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-04-01T07:35:27.644 INFO:teuthology.orchestra.console.smithi042:Power on completed
2024-04-01T07:35:27.649 INFO:teuthology.orchestra.console.smithi177:Power on completed
2024-04-01T07:35:27.656 INFO:teuthology.orchestra.console.smithi130:Power on completed
2024-04-01T07:35:27.746 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish
2024-04-01T07:35:27.750 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2024-04-01T07:35:27.757 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish
2024-04-01T07:37:58.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:37:58.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:37:58.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:37:59.038 ERROR:teuthology.orchestra.connection:Error authenticating with smithi130.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-01T07:38:01.822 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T07:38:01.823 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-04-01T07:38:07.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:07.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:10.882 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-04-01T07:38:10.882 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T07:38:16.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:16.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:19.934 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-04-01T07:38:19.966 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T07:38:25.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:25.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:28.990 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-04-01T07:38:29.022 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T07:38:34.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:35.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:38.046 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-04-01T07:38:38.078 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-04-01T07:38:44.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:44.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:47.102 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-04-01T07:38:53.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:38:56.162 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-04-01T07:39:02.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:39:03.042 WARNING:teuthology.provision.fog.smithi130:timed out
2024-04-01T07:39:09.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:39:27.390 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-04-01T07:39:33.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:39:36.446 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-04-01T07:39:42.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:39:42.718 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T07:39:42.718 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T07:39:44.081 WARNING:teuthology.provision.fog.smithi042:timed out
2024-04-01T07:39:50.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:39:50.365 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T07:39:50.365 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T07:39:50.723 INFO:teuthology.provision.fog.smithi042:Node is ready
2024-04-01T07:39:50.724 DEBUG:teuthology.orchestra.run.smithi042:> hostname
2024-04-01T07:39:50.739 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com
2024-04-01T07:39:50.740 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts
2024-04-01T07:39:50.796 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042
2024-04-01T07:39:50.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2024-04-01T07:39:50.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts
2024-04-01T07:39:50.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts
2024-04-01T07:39:51.008 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname
2024-04-01T07:39:51.080 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2024-04-01T07:39:51.151 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2024-04-01T07:39:51.206 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2024-04-01T07:39:51.206 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9"
2024-04-01T07:39:51.206 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2024-04-01T07:39:51.206 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2024-04-01T07:39:51.206 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9"
2024-04-01T07:39:51.206 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9"
2024-04-01T07:39:51.206 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T07:39:51.206 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2024-04-01T07:39:51.207 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon"
2024-04-01T07:39:51.207 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T07:39:51.207 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2024-04-01T07:39:51.207 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T07:39:51.207 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T07:39:51.207 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T07:39:51.208 INFO:teuthology.provision.fog.smithi042:Deploy complete!
2024-04-01T07:39:51.209 DEBUG:teuthology.parallel:result is None
2024-04-01T07:40:02.166 WARNING:teuthology.provision.fog.smithi177:timed out
2024-04-01T07:40:03.045 INFO:teuthology.provision.fog.smithi130:Node is ready
2024-04-01T07:40:03.045 DEBUG:teuthology.orchestra.run.smithi130:> hostname
2024-04-01T07:40:03.063 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com
2024-04-01T07:40:03.063 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi130.front.sepia.ceph.com /etc/hosts
2024-04-01T07:40:03.120 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130
2024-04-01T07:40:03.120 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2024-04-01T07:40:03.365 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hosts
2024-04-01T07:40:03.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts
2024-04-01T07:40:03.467 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hostname
2024-04-01T07:40:03.536 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2024-04-01T07:40:03.603 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2024-04-01T07:40:03.659 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream"
2024-04-01T07:40:03.659 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9"
2024-04-01T07:40:03.659 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos"
2024-04-01T07:40:03.659 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora"
2024-04-01T07:40:03.659 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T07:40:03.660 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T07:40:03.660 INFO:teuthology.provision.fog.smithi130:Deploy complete!
2024-04-01T07:40:03.661 DEBUG:teuthology.parallel:result is None
2024-04-01T07:40:08.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:40:08.398 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T07:40:08.398 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T07:40:08.712 INFO:teuthology.provision.fog.smithi177:Node is ready
2024-04-01T07:40:08.712 DEBUG:teuthology.orchestra.run.smithi177:> hostname
2024-04-01T07:40:08.726 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com
2024-04-01T07:40:08.726 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts
2024-04-01T07:40:08.784 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2024-04-01T07:40:08.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-04-01T07:40:08.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts
2024-04-01T07:40:08.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts
2024-04-01T07:40:08.995 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname
2024-04-01T07:40:09.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-04-01T07:40:09.134 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-04-01T07:40:09.192 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2024-04-01T07:40:09.192 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9"
2024-04-01T07:40:09.192 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2024-04-01T07:40:09.192 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2024-04-01T07:40:09.192 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9"
2024-04-01T07:40:09.192 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9"
2024-04-01T07:40:09.192 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T07:40:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-04-01T07:40:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon"
2024-04-01T07:40:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T07:40:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2024-04-01T07:40:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T07:40:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T07:40:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T07:40:09.193 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2024-04-01T07:40:09.194 DEBUG:teuthology.parallel:result is None
2024-04-01T07:40:09.407 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com
2024-04-01T07:40:09.408 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T07:40:09.433 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com
2024-04-01T07:40:09.433 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T07:40:09.449 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2024-04-01T07:40:09.450 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T07:40:09.468 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server
2024-04-01T07:40:09.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com'
2024-04-01T07:40:09.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:40:09.572 DEBUG:teuthology.orchestra.run.smithi042:> true
2024-04-01T07:40:09.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com'
2024-04-01T07:40:09.756 DEBUG:teuthology.orchestra.run.smithi042:> uname -m
2024-04-01T07:40:09.812 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64
2024-04-01T07:40:09.812 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2024-04-01T07:40:09.867 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T07:40:09.868 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T07:40:09.868 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T07:40:09.868 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2024-04-01T07:40:09.883 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server
2024-04-01T07:40:09.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com'
2024-04-01T07:40:09.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:40:09.971 DEBUG:teuthology.orchestra.run.smithi130:> true
2024-04-01T07:40:10.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com'
2024-04-01T07:40:10.043 DEBUG:teuthology.orchestra.run.smithi130:> uname -m
2024-04-01T07:40:10.099 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64
2024-04-01T07:40:10.100 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon"
2024-04-01T07:40:10.157 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T07:40:10.158 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/"
2024-04-01T07:40:10.158 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T07:40:10.158 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T07:40:10.158 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T07:40:10.158 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2024-04-01T07:40:10.183 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2024-04-01T07:40:10.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-04-01T07:40:10.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T07:40:10.270 DEBUG:teuthology.orchestra.run.smithi177:> true
2024-04-01T07:40:10.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-04-01T07:40:10.337 DEBUG:teuthology.orchestra.run.smithi177:> uname -m
2024-04-01T07:40:10.395 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2024-04-01T07:40:10.396 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2024-04-01T07:40:10.454 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T07:40:10.455 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T07:40:10.455 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T07:40:10.455 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-04-01T07:40:10.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:40:10.581 INFO:teuthology.dispatcher.supervisor:Running job 7632105
2024-04-01T07:40:10.581 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632105 --name pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/direct_io}} -- /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632105/orig.config.yaml
2024-04-01T07:40:10.585 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632105
2024-04-01T07:40:10.585 INFO:teuthology.dispatcher.supervisor:Job PID: 1035338
2024-04-01T07:40:10.585 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-01T07:42:10.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:44:10.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:46:10.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:48:10.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:50:10.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:52:10.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:54:11.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:56:11.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T07:56:11.201 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1