2024-02-26T04:26:46.380 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-26T04:26:46.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:26:46.545 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3af120af10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3af226bc10>, signals=[15])
2024-02-26T04:26:46.546 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2024-02-26T04:26:46.546 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2024-02-26T04:26:46.546 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-02-26T04:26:46.568 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2024-02-26T04:26:46.568 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2024-02-26T04:26:46.568 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2024-02-26T04:26:46.592 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging
2024-02-26T04:26:46.593 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server
2024-02-26T04:26:46.593 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2024-02-26T04:26:46.675 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10)
2024-02-26T04:26:46.722 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream
2024-02-26T04:26:46.728 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_9.stream (ID 10)
2024-02-26T04:26:46.732 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10)
2024-02-26T04:26:46.780 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 9.stream
2024-02-26T04:26:46.784 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream
2024-02-26T04:26:47.389 INFO:teuthology.orchestra.console.smithi102:Power off
2024-02-26T04:26:47.389 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-26T04:26:47.409 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2024-02-26T04:26:47.409 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:47.425 INFO:teuthology.orchestra.console.smithi190:Power off
2024-02-26T04:26:47.425 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-26T04:26:47.438 INFO:teuthology.orchestra.console.smithi154:Power off
2024-02-26T04:26:47.438 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-26T04:26:47.445 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-02-26T04:26:47.446 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off
2024-02-26T04:26:47.446 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:47.460 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2024-02-26T04:26:47.460 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:47.468 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2024-02-26T04:26:47.481 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-02-26T04:26:47.546 INFO:teuthology.orchestra.console.smithi102:Power off completed
2024-02-26T04:26:47.569 INFO:teuthology.orchestra.console.smithi190:Power off completed
2024-02-26T04:26:47.647 INFO:teuthology.orchestra.console.smithi102:Power on
2024-02-26T04:26:47.648 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-26T04:26:47.668 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2024-02-26T04:26:47.669 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:47.676 INFO:teuthology.orchestra.console.smithi190:Power on
2024-02-26T04:26:47.676 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-26T04:26:47.690 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-02-26T04:26:47.698 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On
2024-02-26T04:26:47.698 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:47.718 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2024-02-26T04:26:51.484 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:51.592 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-02-26T04:26:51.691 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:51.720 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:51.800 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-02-26T04:26:51.828 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2024-02-26T04:26:51.901 INFO:teuthology.orchestra.console.smithi102:Power on completed
2024-02-26T04:26:51.929 INFO:teuthology.orchestra.console.smithi190:Power on completed
2024-02-26T04:26:52.002 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2024-02-26T04:26:52.030 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2024-02-26T04:26:55.596 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:55.704 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-02-26T04:26:59.706 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:26:59.815 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-02-26T04:26:59.915 INFO:teuthology.orchestra.console.smithi154:Power off completed
2024-02-26T04:27:00.016 INFO:teuthology.orchestra.console.smithi154:Power on
2024-02-26T04:27:00.016 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-26T04:27:00.043 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2024-02-26T04:27:00.043 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:27:00.064 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2024-02-26T04:27:04.068 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-26T04:27:04.176 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2024-02-26T04:27:04.277 INFO:teuthology.orchestra.console.smithi154:Power on completed
2024-02-26T04:27:04.377 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2024-02-26T04:30:15.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:30:18.492 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-02-26T04:30:24.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:30:27.580 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-02-26T04:30:33.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:30:36.639 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-02-26T04:30:42.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:30:45.724 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-02-26T04:30:51.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:30:54.780 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-02-26T04:31:00.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:31:03.836 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-02-26T04:31:09.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:31:12.892 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2024-02-26T04:31:18.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:31:22.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:31:25.692 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:31:31.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:31:34.780 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:31:40.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:31:43.868 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:31:49.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:31:52.924 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:31:58.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:32:02.012 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:32:08.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:32:11.068 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:32:17.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:32:18.904 WARNING:teuthology.provision.fog.smithi154:timed out
2024-02-26T04:32:20.156 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:32:24.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:32:25.175 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-26T04:32:25.175 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-26T04:32:25.486 INFO:teuthology.provision.fog.smithi154:Node is ready
2024-02-26T04:32:25.486 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2024-02-26T04:32:25.500 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2024-02-26T04:32:25.501 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2024-02-26T04:32:25.556 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2024-02-26T04:32:25.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2024-02-26T04:32:25.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2024-02-26T04:32:25.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2024-02-26T04:32:25.755 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2024-02-26T04:32:25.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2024-02-26T04:32:25.888 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-26T04:32:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2024-02-26T04:32:25.944 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-26T04:32:25.944 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-26T04:32:25.944 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-26T04:32:25.944 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2024-02-26T04:32:25.946 DEBUG:teuthology.parallel:result is None
2024-02-26T04:32:26.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:32:44.604 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:32:50.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:32:53.696 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:32:59.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:33:02.780 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-02-26T04:33:08.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:33:09.206 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-26T04:33:09.206 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-26T04:33:24.701 INFO:teuthology.provision.fog.smithi102:Node is ready
2024-02-26T04:33:24.701 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2024-02-26T04:33:24.758 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2024-02-26T04:33:24.759 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2024-02-26T04:33:24.825 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2024-02-26T04:33:24.826 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-02-26T04:33:24.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2024-02-26T04:33:24.986 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2024-02-26T04:33:25.054 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2024-02-26T04:33:25.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-02-26T04:33:25.190 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-02-26T04:33:25.245 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-26T04:33:25.246 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-26T04:33:25.247 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2024-02-26T04:33:25.247 DEBUG:teuthology.parallel:result is None
2024-02-26T04:33:51.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:33:55.068 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:34:01.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:34:04.156 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:34:10.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:34:13.244 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:34:19.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:34:22.332 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:34:28.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:34:31.420 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:34:37.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:34:40.508 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:34:46.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:35:04.892 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:35:10.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:35:13.980 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:35:19.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:35:23.036 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-02-26T04:35:29.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:35:29.302 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-26T04:35:29.302 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-26T04:35:44.671 INFO:teuthology.provision.fog.smithi190:Node is ready
2024-02-26T04:35:44.671 DEBUG:teuthology.orchestra.run.smithi190:> hostname
2024-02-26T04:35:44.689 INFO:teuthology.orchestra.run.smithi190.stdout:smithi046
2024-02-26T04:35:44.689 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi046 /etc/hosts
2024-02-26T04:35:44.746 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-02-26T04:35:44.746 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2024-02-26T04:35:44.906 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi046/smithi190/g' /etc/hosts
2024-02-26T04:35:44.936 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.46/172.21.15.190/g' /etc/hosts
2024-02-26T04:35:45.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi046/smithi190/g' /etc/hostname
2024-02-26T04:35:45.074 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2024-02-26T04:35:45.141 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release
2024-02-26T04:35:45.196 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream"
2024-02-26T04:35:45.196 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9"
2024-02-26T04:35:45.196 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos"
2024-02-26T04:35:45.196 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora"
2024-02-26T04:35:45.196 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9"
2024-02-26T04:35:45.196 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9"
2024-02-26T04:35:45.196 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-26T04:35:45.197 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2024-02-26T04:35:45.197 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon"
2024-02-26T04:35:45.197 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-26T04:35:45.197 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/"
2024-02-26T04:35:45.197 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-26T04:35:45.197 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-26T04:35:45.197 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-26T04:35:45.197 INFO:teuthology.provision.fog.smithi190:Deploy complete!
2024-02-26T04:35:45.198 DEBUG:teuthology.parallel:result is None
2024-02-26T04:35:45.407 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2024-02-26T04:35:45.407 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-26T04:35:45.430 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2024-02-26T04:35:45.430 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-26T04:35:45.446 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com
2024-02-26T04:35:45.446 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-26T04:35:45.464 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2024-02-26T04:35:45.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-02-26T04:35:45.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:35:45.551 DEBUG:teuthology.orchestra.run.smithi102:> true
2024-02-26T04:35:45.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-02-26T04:35:45.718 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2024-02-26T04:35:45.771 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2024-02-26T04:35:45.771 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-02-26T04:35:45.825 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-02-26T04:35:45.825 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-02-26T04:35:45.825 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-02-26T04:35:45.825 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-02-26T04:35:45.825 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-26T04:35:45.826 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-26T04:35:45.827 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-02-26T04:35:45.847 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2024-02-26T04:35:45.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2024-02-26T04:35:45.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:35:45.935 DEBUG:teuthology.orchestra.run.smithi154:> true
2024-02-26T04:35:46.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com'
2024-02-26T04:35:46.103 DEBUG:teuthology.orchestra.run.smithi154:> uname -m
2024-02-26T04:35:46.157 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2024-02-26T04:35:46.157 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-26T04:35:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2024-02-26T04:35:46.214 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-26T04:35:46.214 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-26T04:35:46.214 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-26T04:35:46.214 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2024-02-26T04:35:46.238 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server
2024-02-26T04:35:46.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2024-02-26T04:35:46.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-26T04:35:46.369 DEBUG:teuthology.orchestra.run.smithi190:> true
2024-02-26T04:35:46.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com'
2024-02-26T04:35:46.441 DEBUG:teuthology.orchestra.run.smithi190:> uname -m
2024-02-26T04:35:46.497 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64
2024-02-26T04:35:46.497 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release
2024-02-26T04:35:46.553 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream"
2024-02-26T04:35:46.553 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9"
2024-02-26T04:35:46.553 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-26T04:35:46.554 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-26T04:35:46.555 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2024-02-26T04:35:46.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:35:46.687 INFO:teuthology.dispatcher.supervisor:Running job 7573379
2024-02-26T04:35:46.687 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-26_04:25:56-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7573379 --name vshankar-2024-02-26_04:25:56-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/vshankar-2024-02-26_04:25:56-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7573379/orig.config.yaml
2024-02-26T04:35:46.690 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-26_04:25:56-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7573379
2024-02-26T04:35:46.691 INFO:teuthology.dispatcher.supervisor:Job PID: 1027704
2024-02-26T04:35:46.691 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-26T04:37:46.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:39:46.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:41:47.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:43:47.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:45:47.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:47:47.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:49:47.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:51:48.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:53:48.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:55:48.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:57:48.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T04:59:48.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:01:48.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:03:49.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:05:49.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:07:49.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:09:49.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:11:49.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:13:50.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:15:50.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:17:50.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:19:50.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:21:50.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:23:50.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:25:50.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:27:51.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-26T05:27:51.134 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1