2024-04-01T09:28:20.091 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-01T09:28:20.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:28:20.275 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5fe6c27f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5fe7c88c10>, signals=[15])
2024-04-01T09:28:20.275 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2024-04-01T09:28:20.275 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T09:28:20.276 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2024-04-01T09:28:20.295 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2024-04-01T09:28:20.295 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T09:28:20.295 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2024-04-01T09:28:20.320 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging
2024-04-01T09:28:20.320 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T09:28:20.320 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2024-04-01T09:28:20.411 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T09:28:20.433 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T09:28:20.448 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T09:28:20.461 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream
2024-04-01T09:28:20.479 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream
2024-04-01T09:28:20.486 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 9.stream
2024-04-01T09:28:20.710 INFO:teuthology.orchestra.console.smithi170:Power off
2024-04-01T09:28:20.710 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T09:28:20.735 INFO:teuthology.orchestra.console.smithi029:Power off
2024-04-01T09:28:20.735 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T09:28:20.749 INFO:teuthology.orchestra.console.smithi052:Power off
2024-04-01T09:28:20.750 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T09:28:20.758 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off
2024-04-01T09:28:20.758 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:20.766 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2024-04-01T09:28:20.766 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:20.777 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2024-04-01T09:28:20.777 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:20.787 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-04-01T09:28:20.790 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-04-01T09:28:20.800 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-04-01T09:28:20.889 INFO:teuthology.orchestra.console.smithi170:Power off completed
2024-04-01T09:28:20.891 INFO:teuthology.orchestra.console.smithi029:Power off completed
2024-04-01T09:28:20.901 INFO:teuthology.orchestra.console.smithi052:Power off completed
2024-04-01T09:28:20.990 INFO:teuthology.orchestra.console.smithi170:Power on
2024-04-01T09:28:20.990 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T09:28:20.998 INFO:teuthology.orchestra.console.smithi029:Power on
2024-04-01T09:28:20.998 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T09:28:21.006 INFO:teuthology.orchestra.console.smithi052:Power on
2024-04-01T09:28:21.006 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T09:28:21.015 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On
2024-04-01T09:28:21.015 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:21.026 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On
2024-04-01T09:28:21.026 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:21.035 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On
2024-04-01T09:28:21.035 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:21.042 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-04-01T09:28:21.047 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-04-01T09:28:21.054 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-04-01T09:28:25.046 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:25.053 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:25.060 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:25.155 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off
2024-04-01T09:28:25.162 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-04-01T09:28:25.168 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-04-01T09:28:29.158 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:29.165 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:29.172 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T09:28:29.293 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2024-04-01T09:28:29.334 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2024-04-01T09:28:29.334 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on
2024-04-01T09:28:29.397 INFO:teuthology.orchestra.console.smithi052:Power on completed
2024-04-01T09:28:29.435 INFO:teuthology.orchestra.console.smithi029:Power on completed
2024-04-01T09:28:29.435 INFO:teuthology.orchestra.console.smithi170:Power on completed
2024-04-01T09:28:29.498 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2024-04-01T09:28:29.536 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2024-04-01T09:28:29.537 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2024-04-01T09:30:45.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:30:48.382 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-04-01T09:30:54.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:30:57.442 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-04-01T09:31:00.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:03.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:03.454 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-01T09:31:06.526 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-04-01T09:31:09.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:12.510 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-01T09:31:12.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:15.582 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-04-01T09:31:18.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:21.570 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-01T09:31:21.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:24.638 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-04-01T09:31:27.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:30.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:30.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:30.654 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-01T09:31:33.602 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-01T09:31:33.698 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-04-01T09:31:36.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:39.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:39.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:39.714 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-01T09:31:42.686 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-01T09:31:45.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:48.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:48.798 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-01T09:31:51.742 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-01T09:31:54.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:57.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:31:57.858 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170
2024-04-01T09:32:00.798 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-01T09:32:03.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:32:06.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:32:09.854 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-01T09:32:15.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:32:18.910 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-01T09:32:24.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:32:39.715 WARNING:teuthology.provision.fog.smithi052:timed out
2024-04-01T09:32:45.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:32:45.966 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T09:32:45.967 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T09:32:46.264 INFO:teuthology.provision.fog.smithi052:Node is ready
2024-04-01T09:32:46.264 DEBUG:teuthology.orchestra.run.smithi052:> hostname
2024-04-01T09:32:46.279 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2024-04-01T09:32:46.279 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts
2024-04-01T09:32:46.334 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2024-04-01T09:32:46.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2024-04-01T09:32:46.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts
2024-04-01T09:32:46.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts
2024-04-01T09:32:46.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname
2024-04-01T09:32:46.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2024-04-01T09:32:46.675 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2024-04-01T09:32:46.730 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2024-04-01T09:32:46.730 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2024-04-01T09:32:46.730 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2024-04-01T09:32:46.730 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:32:46.730 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2024-04-01T09:32:46.730 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:32:46.730 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:32:46.730 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2024-04-01T09:32:46.731 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:32:46.731 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:32:46.731 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:32:46.731 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:32:46.731 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:32:46.731 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:32:46.732 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2024-04-01T09:32:46.734 DEBUG:teuthology.parallel:result is None
2024-04-01T09:33:03.882 WARNING:teuthology.provision.fog.smithi170:timed out
2024-04-01T09:33:09.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:33:10.128 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T09:33:10.128 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T09:33:10.433 INFO:teuthology.provision.fog.smithi170:Node is ready
2024-04-01T09:33:10.433 DEBUG:teuthology.orchestra.run.smithi170:> hostname
2024-04-01T09:33:10.448 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2024-04-01T09:33:10.448 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts
2024-04-01T09:33:10.503 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2024-04-01T09:33:10.503 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170
2024-04-01T09:33:10.608 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts
2024-04-01T09:33:10.635 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts
2024-04-01T09:33:10.703 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname
2024-04-01T09:33:10.770 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170
2024-04-01T09:33:10.837 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release
2024-04-01T09:33:10.891 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream"
2024-04-01T09:33:10.891 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9"
2024-04-01T09:33:10.891 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2024-04-01T09:33:10.891 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:33:10.891 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9"
2024-04-01T09:33:10.891 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:33:10.891 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:33:10.891 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2024-04-01T09:33:10.892 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:33:10.892 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:33:10.892 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:33:10.892 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:33:10.892 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:33:10.892 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:33:10.892 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2024-04-01T09:33:10.893 DEBUG:teuthology.parallel:result is None
2024-04-01T09:33:24.930 WARNING:teuthology.provision.fog.smithi029:timed out
2024-04-01T09:33:30.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:33:31.209 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T09:33:31.209 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T09:33:31.572 INFO:teuthology.provision.fog.smithi029:Node is ready
2024-04-01T09:33:31.572 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2024-04-01T09:33:31.587 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2024-04-01T09:33:31.588 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2024-04-01T09:33:31.643 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2024-04-01T09:33:31.645 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2024-04-01T09:33:31.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2024-04-01T09:33:31.817 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2024-04-01T09:33:31.888 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2024-04-01T09:33:31.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2024-04-01T09:33:32.030 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2024-04-01T09:33:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2024-04-01T09:33:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9"
2024-04-01T09:33:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2024-04-01T09:33:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:33:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9"
2024-04-01T09:33:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:33:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:33:32.086 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2024-04-01T09:33:32.086 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:33:32.086 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:33:32.086 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:33:32.086 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:33:32.086 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:33:32.086 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:33:32.086 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2024-04-01T09:33:32.087 DEBUG:teuthology.parallel:result is None
2024-04-01T09:33:32.308 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2024-04-01T09:33:32.308 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T09:33:32.333 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2024-04-01T09:33:32.333 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T09:33:32.349 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2024-04-01T09:33:32.349 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T09:33:32.367 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2024-04-01T09:33:32.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2024-04-01T09:33:32.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:33:32.477 DEBUG:teuthology.orchestra.run.smithi029:> true
2024-04-01T09:33:32.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2024-04-01T09:33:32.545 DEBUG:teuthology.orchestra.run.smithi029:> uname -m
2024-04-01T09:33:32.600 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2024-04-01T09:33:32.600 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2024-04-01T09:33:32.654 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2024-04-01T09:33:32.654 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:33:32.655 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:33:32.656 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2024-04-01T09:33:32.677 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2024-04-01T09:33:32.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2024-04-01T09:33:32.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:33:32.803 DEBUG:teuthology.orchestra.run.smithi052:> true
2024-04-01T09:33:32.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2024-04-01T09:33:32.985 DEBUG:teuthology.orchestra.run.smithi052:> uname -m
2024-04-01T09:33:33.040 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2024-04-01T09:33:33.040 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2024-04-01T09:33:33.095 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2024-04-01T09:33:33.095 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2024-04-01T09:33:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2024-04-01T09:33:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:33:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2024-04-01T09:33:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:33:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:33:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2024-04-01T09:33:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:33:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:33:33.097 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:33:33.097 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:33:33.097 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:33:33.097 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:33:33.097 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2024-04-01T09:33:33.116 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2024-04-01T09:33:33.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2024-04-01T09:33:33.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T09:33:33.203 DEBUG:teuthology.orchestra.run.smithi170:> true
2024-04-01T09:33:33.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com'
2024-04-01T09:33:33.372 DEBUG:teuthology.orchestra.run.smithi170:> uname -m
2024-04-01T09:33:33.427 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2024-04-01T09:33:33.428 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release
2024-04-01T09:33:33.482 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T09:33:33.483 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T09:33:33.484 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2024-04-01T09:33:33.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:33:33.606 INFO:teuthology.dispatcher.supervisor:Running job 7632239
2024-04-01T09:33:33.606 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632239 --name pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632239/orig.config.yaml
2024-04-01T09:33:33.609 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-31_08:09:41-fs-wip-batrick-testing-20240331.000745-distro-default-smithi/7632239
2024-04-01T09:33:33.609 INFO:teuthology.dispatcher.supervisor:Job PID: 1630504
2024-04-01T09:33:33.609 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-01T09:35:33.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:37:33.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:39:34.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:41:34.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:43:34.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:45:34.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:47:34.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:49:34.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T09:49:34.961 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1