2024-02-09T05:19:37.548 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22
2024-02-09T05:19:37.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-09T05:19:37.735 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f135103bf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f135209cc10>, signals=[15])
2024-02-09T05:19:37.735 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging
2024-02-09T05:19:37.735 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server
2024-02-09T05:19:37.735 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2024-02-09T05:19:37.767 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2024-02-09T05:19:37.768 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2024-02-09T05:19:37.768 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2024-02-09T05:19:37.809 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging
2024-02-09T05:19:37.809 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server
2024-02-09T05:19:37.809 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-02-09T05:19:37.935 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_9.stream (ID 10)
2024-02-09T05:19:37.969 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_9.stream (ID 10)
2024-02-09T05:19:37.984 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_9.stream (ID 10)
2024-02-09T05:19:37.995 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 9.stream
2024-02-09T05:19:38.036 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 9.stream
2024-02-09T05:19:38.067 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 9.stream
2024-02-09T05:19:38.312 INFO:teuthology.orchestra.console.smithi039:Power off
2024-02-09T05:19:38.312 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-09T05:19:38.361 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off
2024-02-09T05:19:38.361 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:38.410 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-02-09T05:19:38.516 INFO:teuthology.orchestra.console.smithi062:Power off
2024-02-09T05:19:38.516 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-09T05:19:38.564 INFO:teuthology.orchestra.console.smithi157:Power off
2024-02-09T05:19:38.564 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-09T05:19:38.572 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2024-02-09T05:19:38.573 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:38.610 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2024-02-09T05:19:38.611 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:38.619 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2024-02-09T05:19:38.656 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-02-09T05:19:42.413 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:42.521 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-02-09T05:19:42.620 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:42.658 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:42.729 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2024-02-09T05:19:42.767 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-02-09T05:19:46.526 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:46.635 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-02-09T05:19:46.730 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:46.768 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:46.839 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2024-02-09T05:19:46.876 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-02-09T05:19:46.940 INFO:teuthology.orchestra.console.smithi062:Power off completed
2024-02-09T05:19:46.977 INFO:teuthology.orchestra.console.smithi157:Power off completed
2024-02-09T05:19:47.041 INFO:teuthology.orchestra.console.smithi062:Power on
2024-02-09T05:19:47.041 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-09T05:19:47.078 INFO:teuthology.orchestra.console.smithi157:Power on
2024-02-09T05:19:47.078 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-09T05:19:47.108 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On
2024-02-09T05:19:47.109 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:47.122 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On
2024-02-09T05:19:47.122 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:47.168 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2024-02-09T05:19:47.172 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-02-09T05:19:50.640 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:50.749 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2024-02-09T05:19:50.850 INFO:teuthology.orchestra.console.smithi039:Power off completed
2024-02-09T05:19:50.950 INFO:teuthology.orchestra.console.smithi039:Power on
2024-02-09T05:19:50.951 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-09T05:19:50.980 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On
2024-02-09T05:19:50.981 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:51.027 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off
2024-02-09T05:19:51.169 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:51.175 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:51.278 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2024-02-09T05:19:51.283 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-02-09T05:19:55.033 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:55.141 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on
2024-02-09T05:19:55.242 INFO:teuthology.orchestra.console.smithi039:Power on completed
2024-02-09T05:19:55.278 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:55.286 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-09T05:19:55.343 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2024-02-09T05:19:55.388 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2024-02-09T05:19:55.394 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-02-09T05:19:55.488 INFO:teuthology.orchestra.console.smithi062:Power on completed
2024-02-09T05:19:55.495 INFO:teuthology.orchestra.console.smithi157:Power on completed
2024-02-09T05:19:55.589 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2024-02-09T05:19:55.600 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2024-02-09T05:22:26.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:22:29.628 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-02-09T05:22:35.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:22:38.716 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-02-09T05:22:44.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:22:47.804 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-02-09T05:22:53.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:22:56.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:22:56.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:22:56.892 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-02-09T05:22:59.484 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:22:59.772 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-02-09T05:23:02.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:05.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:05.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:05.980 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-02-09T05:23:08.572 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:23:08.860 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-02-09T05:23:11.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:14.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:14.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:15.071 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-02-09T05:23:17.664 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:23:17.948 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-02-09T05:23:21.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:23.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:23.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:24.160 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-02-09T05:23:26.748 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:23:27.040 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-02-09T05:23:30.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:32.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:33.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:35.836 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:23:36.124 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-02-09T05:23:41.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:42.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:44.928 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:23:45.212 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-02-09T05:23:50.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:51.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:23:54.012 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:23:54.300 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-02-09T05:24:00.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:24:00.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:24:03.100 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:24:03.388 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-02-09T05:24:09.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:24:09.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:24:12.188 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39
2024-02-09T05:24:18.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:24:30.188 WARNING:teuthology.provision.fog.smithi062:timed out
2024-02-09T05:24:36.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:24:36.427 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-09T05:24:36.428 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-09T05:24:36.754 INFO:teuthology.provision.fog.smithi062:Node is ready
2024-02-09T05:24:36.754 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2024-02-09T05:24:36.769 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2024-02-09T05:24:36.769 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2024-02-09T05:24:36.825 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2024-02-09T05:24:36.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2024-02-09T05:24:36.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2024-02-09T05:24:36.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2024-02-09T05:24:37.036 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2024-02-09T05:24:37.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2024-02-09T05:24:37.178 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2024-02-09T05:24:37.233 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2024-02-09T05:24:37.233 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9"
2024-02-09T05:24:37.233 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2024-02-09T05:24:37.233 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2024-02-09T05:24:37.233 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9"
2024-02-09T05:24:37.233 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9"
2024-02-09T05:24:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-09T05:24:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2024-02-09T05:24:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon"
2024-02-09T05:24:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-09T05:24:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2024-02-09T05:24:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-09T05:24:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-09T05:24:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-09T05:24:37.235 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2024-02-09T05:24:37.236 DEBUG:teuthology.parallel:result is None
2024-02-09T05:25:09.432 WARNING:teuthology.provision.fog.smithi157:timed out
2024-02-09T05:25:15.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:25:15.697 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-09T05:25:15.698 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-09T05:25:16.031 INFO:teuthology.provision.fog.smithi157:Node is ready
2024-02-09T05:25:16.031 DEBUG:teuthology.orchestra.run.smithi157:> hostname
2024-02-09T05:25:16.045 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2024-02-09T05:25:16.046 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts
2024-02-09T05:25:16.102 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2024-02-09T05:25:16.102 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-02-09T05:25:16.204 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts
2024-02-09T05:25:16.233 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts
2024-02-09T05:25:16.301 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname
2024-02-09T05:25:16.368 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-02-09T05:25:16.436 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-02-09T05:25:16.491 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-02-09T05:25:16.491 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9"
2024-02-09T05:25:16.491 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-02-09T05:25:16.491 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-09T05:25:16.492 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-09T05:25:16.493 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2024-02-09T05:25:16.493 DEBUG:teuthology.parallel:result is None
2024-02-09T05:25:18.204 WARNING:teuthology.provision.fog.smithi039:timed out
2024-02-09T05:25:24.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:25:24.486 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-09T05:25:24.486 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-09T05:25:24.810 INFO:teuthology.provision.fog.smithi039:Node is ready
2024-02-09T05:25:24.810 DEBUG:teuthology.orchestra.run.smithi039:> hostname
2024-02-09T05:25:24.825 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com
2024-02-09T05:25:24.826 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts
2024-02-09T05:25:24.882 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039
2024-02-09T05:25:24.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2024-02-09T05:25:24.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts
2024-02-09T05:25:25.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts
2024-02-09T05:25:25.100 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname
2024-02-09T05:25:25.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039
2024-02-09T05:25:25.242 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2024-02-09T05:25:25.297 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream"
2024-02-09T05:25:25.297 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9"
2024-02-09T05:25:25.297 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos"
2024-02-09T05:25:25.297 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora"
2024-02-09T05:25:25.297 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9"
2024-02-09T05:25:25.297 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9"
2024-02-09T05:25:25.297 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-09T05:25:25.297 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2024-02-09T05:25:25.298 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon"
2024-02-09T05:25:25.298 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-09T05:25:25.298 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/"
2024-02-09T05:25:25.298 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-09T05:25:25.298 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-09T05:25:25.298 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-09T05:25:25.298 INFO:teuthology.provision.fog.smithi039:Deploy complete!
2024-02-09T05:25:25.299 DEBUG:teuthology.parallel:result is None
2024-02-09T05:25:25.724 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com
2024-02-09T05:25:25.725 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-09T05:25:25.753 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2024-02-09T05:25:25.753 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-09T05:25:25.786 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2024-02-09T05:25:25.786 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-09T05:25:25.813 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server
2024-02-09T05:25:25.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2024-02-09T05:25:25.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:25:25.922 DEBUG:teuthology.orchestra.run.smithi039:> true
2024-02-09T05:25:25.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com'
2024-02-09T05:25:25.995 DEBUG:teuthology.orchestra.run.smithi039:> uname -m
2024-02-09T05:25:26.050 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64
2024-02-09T05:25:26.051 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-09T05:25:26.106 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/"
2024-02-09T05:25:26.107 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-09T05:25:26.107 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-09T05:25:26.107 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-09T05:25:26.107 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2024-02-09T05:25:26.137 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2024-02-09T05:25:26.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2024-02-09T05:25:26.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:25:26.247 DEBUG:teuthology.orchestra.run.smithi062:> true
2024-02-09T05:25:26.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2024-02-09T05:25:26.431 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2024-02-09T05:25:26.486 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2024-02-09T05:25:26.486 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2024-02-09T05:25:26.542 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2024-02-09T05:25:26.542 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9"
2024-02-09T05:25:26.542 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2024-02-09T05:25:26.542 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-09T05:25:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-09T05:25:26.544 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2024-02-09T05:25:26.570 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2024-02-09T05:25:26.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-02-09T05:25:26.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-09T05:25:26.668 DEBUG:teuthology.orchestra.run.smithi157:> true
2024-02-09T05:25:26.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-02-09T05:25:26.736 DEBUG:teuthology.orchestra.run.smithi157:> uname -m
2024-02-09T05:25:26.792 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2024-02-09T05:25:26.792 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9"
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9"
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9"
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-02-09T05:25:26.849 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon"
2024-02-09T05:25:26.850 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-09T05:25:26.850 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-02-09T05:25:26.850 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-09T05:25:26.850 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-09T05:25:26.850 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-09T05:25:26.850 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-02-09T05:25:26.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-09T05:25:26.982 INFO:teuthology.dispatcher.supervisor:Running job 7553685
2024-02-09T05:25:26.982 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-09_04:42:29-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7553685 --name vshankar-2024-02-09_04:42:29-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/vshankar-2024-02-09_04:42:29-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7553685/orig.config.yaml
2024-02-09T05:25:26.986 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-09_04:42:29-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7553685
2024-02-09T05:25:26.986 INFO:teuthology.dispatcher.supervisor:Job PID: 1695256
2024-02-09T05:25:26.986 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-09T05:27:27.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-09T05:29:27.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-09T05:29:27.358 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-02-09T05:29:27.539 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi039 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-02-08_23:15:40-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7552890
2024-02-09T05:29:27.539 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-02-08_23:15:40-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7552865
2024-02-09T05:29:27.539 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-02-08_23:15:40-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7552904