2024-04-17T14:39:58.387 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-17T14:39:58.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:39:58.569 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3d46665f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3d476c6c10>, signals=[15])
2024-04-17T14:39:58.569 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging
2024-04-17T14:39:58.569 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:58.570 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2024-04-17T14:39:58.604 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2024-04-17T14:39:58.604 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:58.604 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2024-04-17T14:39:58.631 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging
2024-04-17T14:39:58.631 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:58.631 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2024-04-17T14:39:58.740 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:58.761 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:58.784 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:58.796 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 9.stream
2024-04-17T14:39:58.820 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 9.stream
2024-04-17T14:39:58.835 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream
2024-04-17T14:39:59.545 INFO:teuthology.orchestra.console.smithi131:Power off
2024-04-17T14:39:59.545 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:39:59.558 INFO:teuthology.orchestra.console.smithi132:Power off
2024-04-17T14:39:59.559 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:39:59.568 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2024-04-17T14:39:59.568 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:59.581 INFO:teuthology.orchestra.console.smithi187:Power off
2024-04-17T14:39:59.581 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:39:59.589 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2024-04-17T14:39:59.589 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:59.596 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-04-17T14:39:59.602 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2024-04-17T14:39:59.602 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:59.610 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-04-17T14:39:59.621 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-04-17T14:39:59.697 INFO:teuthology.orchestra.console.smithi131:Power off completed
2024-04-17T14:39:59.710 INFO:teuthology.orchestra.console.smithi132:Power off completed
2024-04-17T14:39:59.723 INFO:teuthology.orchestra.console.smithi187:Power off completed
2024-04-17T14:39:59.798 INFO:teuthology.orchestra.console.smithi131:Power on
2024-04-17T14:39:59.798 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:39:59.811 INFO:teuthology.orchestra.console.smithi132:Power on
2024-04-17T14:39:59.812 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:39:59.821 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On
2024-04-17T14:39:59.822 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:59.830 INFO:teuthology.orchestra.console.smithi187:Power on
2024-04-17T14:39:59.830 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:39:59.838 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2024-04-17T14:39:59.838 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:59.846 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-04-17T14:39:59.850 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On
2024-04-17T14:39:59.850 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:59.859 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-04-17T14:39:59.870 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-04-17T14:40:03.850 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:03.860 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:03.871 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:03.959 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2024-04-17T14:40:03.968 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-04-17T14:40:03.978 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2024-04-17T14:40:04.061 INFO:teuthology.orchestra.console.smithi131:Power on completed
2024-04-17T14:40:04.161 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2024-04-17T14:40:07.970 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:07.979 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:08.080 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2024-04-17T14:40:08.088 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2024-04-17T14:40:08.181 INFO:teuthology.orchestra.console.smithi132:Power on completed
2024-04-17T14:40:08.188 INFO:teuthology.orchestra.console.smithi187:Power on completed
2024-04-17T14:40:08.282 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2024-04-17T14:40:08.289 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2024-04-17T14:43:11.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:11.951 ERROR:teuthology.orchestra.connection:Error authenticating with smithi132.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:43:22.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:25.822 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-17T14:43:31.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:34.878 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-17T14:43:40.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:43.934 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-17T14:43:49.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:43:52.990 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-17T14:43:58.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:02.046 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-17T14:44:08.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:11.102 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-17T14:44:15.955 WARNING:teuthology.provision.fog.smithi132:timed out
2024-04-17T14:44:17.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:20.158 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-17T14:44:21.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:26.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:40.350 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-04-17T14:44:46.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:49.406 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-04-17T14:44:55.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:55.700 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:44:55.701 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:44:58.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:01.182 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:45:07.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:10.238 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:45:15.914 INFO:teuthology.provision.fog.smithi132:Node is ready
2024-04-17T14:45:15.914 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2024-04-17T14:45:15.932 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2024-04-17T14:45:15.933 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts
2024-04-17T14:45:15.990 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2024-04-17T14:45:15.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2024-04-17T14:45:16.109 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts
2024-04-17T14:45:16.139 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2024-04-17T14:45:16.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname
2024-04-17T14:45:16.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:16.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2024-04-17T14:45:16.345 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2024-04-17T14:45:16.399 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream"
2024-04-17T14:45:16.399 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9"
2024-04-17T14:45:16.399 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos"
2024-04-17T14:45:16.399 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:45:16.399 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9"
2024-04-17T14:45:16.399 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:45:16.399 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:45:16.399 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2024-04-17T14:45:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:45:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:45:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:45:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:45:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:45:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:45:16.400 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2024-04-17T14:45:16.402 DEBUG:teuthology.parallel:result is None
2024-04-17T14:45:19.298 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:45:25.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:26.161 WARNING:teuthology.provision.fog.smithi131:timed out
2024-04-17T14:45:28.354 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:45:32.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:32.496 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:45:32.496 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:45:32.803 INFO:teuthology.provision.fog.smithi131:Node is ready
2024-04-17T14:45:32.804 DEBUG:teuthology.orchestra.run.smithi131:> hostname
2024-04-17T14:45:32.818 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2024-04-17T14:45:32.818 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts
2024-04-17T14:45:32.874 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2024-04-17T14:45:32.875 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2024-04-17T14:45:32.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts
2024-04-17T14:45:33.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts
2024-04-17T14:45:33.069 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname
2024-04-17T14:45:33.135 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2024-04-17T14:45:33.202 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2024-04-17T14:45:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2024-04-17T14:45:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9"
2024-04-17T14:45:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2024-04-17T14:45:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:45:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9"
2024-04-17T14:45:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:45:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:45:33.256 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2024-04-17T14:45:33.257 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:45:33.257 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:45:33.257 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:45:33.257 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:45:33.257 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:45:33.257 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:45:33.257 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2024-04-17T14:45:33.258 DEBUG:teuthology.parallel:result is None
2024-04-17T14:45:34.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:37.406 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:45:43.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:46.462 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:45:52.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:55.518 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:46:01.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:19.934 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:46:25.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:28.990 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:46:34.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:38.046 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2024-04-17T14:46:44.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:44.285 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:46:44.285 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:47:04.604 INFO:teuthology.provision.fog.smithi187:Node is ready
2024-04-17T14:47:04.604 DEBUG:teuthology.orchestra.run.smithi187:> hostname
2024-04-17T14:47:04.622 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com
2024-04-17T14:47:04.622 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts
2024-04-17T14:47:04.680 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187
2024-04-17T14:47:04.680 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2024-04-17T14:47:04.812 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts
2024-04-17T14:47:04.843 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts
2024-04-17T14:47:04.913 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname
2024-04-17T14:47:04.982 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2024-04-17T14:47:05.049 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2024-04-17T14:47:05.104 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2024-04-17T14:47:05.104 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9"
2024-04-17T14:47:05.104 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2024-04-17T14:47:05.104 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:47:05.104 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:47:05.105 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:47:05.105 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2024-04-17T14:47:05.106 DEBUG:teuthology.parallel:result is None
2024-04-17T14:47:05.319 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2024-04-17T14:47:05.319 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:47:05.349 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2024-04-17T14:47:05.349 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:47:05.365 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2024-04-17T14:47:05.365 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:47:05.384 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:47:05.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2024-04-17T14:47:05.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:05.471 DEBUG:teuthology.orchestra.run.smithi131:> true
2024-04-17T14:47:05.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com'
2024-04-17T14:47:05.636 DEBUG:teuthology.orchestra.run.smithi131:> uname -m
2024-04-17T14:47:05.690 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2024-04-17T14:47:05.690 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2024-04-17T14:47:05.744 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2024-04-17T14:47:05.744 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9"
2024-04-17T14:47:05.744 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2024-04-17T14:47:05.744 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:47:05.744 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9"
2024-04-17T14:47:05.744 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:47:05.745 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:47:05.745 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2024-04-17T14:47:05.745 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:47:05.745 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:47:05.745 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:47:05.745 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:47:05.745 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:47:05.745 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:47:05.745 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2024-04-17T14:47:05.774 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:47:05.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2024-04-17T14:47:05.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:05.859 DEBUG:teuthology.orchestra.run.smithi132:> true
2024-04-17T14:47:06.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2024-04-17T14:47:06.024 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2024-04-17T14:47:06.079 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2024-04-17T14:47:06.079 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:47:06.133 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:47:06.134 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:47:06.134 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:47:06.134 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:47:06.134 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:47:06.134 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2024-04-17T14:47:06.157 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:47:06.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2024-04-17T14:47:06.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:06.243 DEBUG:teuthology.orchestra.run.smithi187:> true
2024-04-17T14:47:06.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com'
2024-04-17T14:47:06.319 DEBUG:teuthology.orchestra.run.smithi187:> uname -m
2024-04-17T14:47:06.375 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2024-04-17T14:47:06.375 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:47:06.431 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:47:06.432 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:47:06.432 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:47:06.432 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:47:06.432 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:47:06.432 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2024-04-17T14:47:06.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:47:06.551 INFO:teuthology.dispatcher.supervisor:Running job 7660395
2024-04-17T14:47:06.551 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660395 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660395/orig.config.yaml
2024-04-17T14:47:06.554 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660395
2024-04-17T14:47:06.554 INFO:teuthology.dispatcher.supervisor:Job PID: 1515784
2024-04-17T14:47:06.555 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T14:49:06.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:51:06.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:53:06.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:55:06.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:57:06.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:59:06.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:59:06.983 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1