2024-03-14T02:49:10.585 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-14T02:49:10.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T02:49:10.766 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f69bb753f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f69bc7b4c10>, signals=[15])
2024-03-14T02:49:10.766 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging
2024-03-14T02:49:10.767 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T02:49:10.767 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2024-03-14T02:49:10.784 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2024-03-14T02:49:10.784 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T02:49:10.784 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2024-03-14T02:49:10.809 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2024-03-14T02:49:10.809 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T02:49:10.809 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2024-03-14T02:49:10.901 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T02:49:10.920 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T02:49:10.942 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10)
2024-03-14T02:49:10.948 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 9.stream
2024-03-14T02:49:10.964 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream
2024-03-14T02:49:10.994 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream
2024-03-14T02:49:11.213 INFO:teuthology.orchestra.console.smithi077:Power off
2024-03-14T02:49:11.214 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T02:49:11.229 INFO:teuthology.orchestra.console.smithi169:Power off
2024-03-14T02:49:11.229 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T02:49:11.243 INFO:teuthology.orchestra.console.smithi136:Power off
2024-03-14T02:49:11.244 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T02:49:11.254 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2024-03-14T02:49:11.254 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:11.261 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off
2024-03-14T02:49:11.262 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:11.271 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2024-03-14T02:49:11.272 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:11.280 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-03-14T02:49:11.285 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-03-14T02:49:11.293 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-03-14T02:49:11.381 INFO:teuthology.orchestra.console.smithi169:Power off completed
2024-03-14T02:49:11.386 INFO:teuthology.orchestra.console.smithi077:Power off completed
2024-03-14T02:49:11.394 INFO:teuthology.orchestra.console.smithi136:Power off completed
2024-03-14T02:49:11.483 INFO:teuthology.orchestra.console.smithi169:Power on
2024-03-14T02:49:11.483 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T02:49:11.490 INFO:teuthology.orchestra.console.smithi077:Power on
2024-03-14T02:49:11.491 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T02:49:11.498 INFO:teuthology.orchestra.console.smithi136:Power on
2024-03-14T02:49:11.499 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T02:49:11.507 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On
2024-03-14T02:49:11.507 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:11.515 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On
2024-03-14T02:49:11.515 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:11.524 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On
2024-03-14T02:49:11.524 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:11.533 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-03-14T02:49:11.538 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-03-14T02:49:11.547 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-03-14T02:49:15.534 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:15.542 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:15.549 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:15.644 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-03-14T02:49:15.651 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on
2024-03-14T02:49:15.657 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-03-14T02:49:15.752 INFO:teuthology.orchestra.console.smithi077:Power on completed
2024-03-14T02:49:15.758 INFO:teuthology.orchestra.console.smithi136:Power on completed
2024-03-14T02:49:15.853 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2024-03-14T02:49:15.858 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2024-03-14T02:49:19.646 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T02:49:19.755 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2024-03-14T02:49:19.856 INFO:teuthology.orchestra.console.smithi169:Power on completed
2024-03-14T02:49:19.956 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2024-03-14T02:51:49.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:51:52.446 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-03-14T02:51:58.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:01.502 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-03-14T02:52:07.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:10.558 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-03-14T02:52:16.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:19.614 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-03-14T02:52:25.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:28.670 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-03-14T02:52:34.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:37.726 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-03-14T02:52:38.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:41.570 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-14T02:52:43.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:46.782 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-03-14T02:52:47.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:50.654 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-14T02:52:52.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:56.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:52:59.710 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-14T02:53:05.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:53:08.766 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-14T02:53:14.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:53:17.854 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-14T02:53:23.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:53:26.914 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-14T02:53:32.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:53:35.998 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-03-14T02:53:42.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:53:52.789 WARNING:teuthology.provision.fog.smithi077:timed out
2024-03-14T02:53:58.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:53:59.133 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T02:53:59.134 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T02:53:59.461 INFO:teuthology.provision.fog.smithi077:Node is ready
2024-03-14T02:53:59.461 DEBUG:teuthology.orchestra.run.smithi077:> hostname
2024-03-14T02:53:59.475 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2024-03-14T02:53:59.476 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts
2024-03-14T02:53:59.531 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2024-03-14T02:53:59.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2024-03-14T02:53:59.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts
2024-03-14T02:53:59.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts
2024-03-14T02:53:59.719 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname
2024-03-14T02:53:59.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2024-03-14T02:53:59.852 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/"
2024-03-14T02:53:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T02:53:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T02:53:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T02:53:59.907 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2024-03-14T02:53:59.908 DEBUG:teuthology.parallel:result is None
2024-03-14T02:54:42.009 WARNING:teuthology.provision.fog.smithi169:timed out
2024-03-14T02:54:48.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:54:48.326 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T02:54:48.326 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T02:54:48.639 INFO:teuthology.provision.fog.smithi169:Node is ready
2024-03-14T02:54:48.639 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2024-03-14T02:54:48.653 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2024-03-14T02:54:48.653 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2024-03-14T02:54:48.711 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2024-03-14T02:54:48.712 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2024-03-14T02:54:48.844 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2024-03-14T02:54:48.872 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2024-03-14T02:54:48.939 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2024-03-14T02:54:49.007 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2024-03-14T02:54:49.073 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2024-03-14T02:54:49.127 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T02:54:49.128 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T02:54:49.129 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T02:54:49.129 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2024-03-14T02:54:49.130 DEBUG:teuthology.parallel:result is None
2024-03-14T02:55:22.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:55:25.214 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-14T02:55:31.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:55:34.270 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-14T02:55:40.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:55:43.358 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-14T02:55:49.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:55:52.414 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-14T02:55:58.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:56:01.502 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-14T02:56:07.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:56:10.558 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-14T02:56:16.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:56:19.646 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-03-14T02:56:25.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:57:25.715 WARNING:teuthology.provision.fog.smithi136:timed out
2024-03-14T02:57:31.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:57:31.967 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T02:57:31.967 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T02:57:32.274 INFO:teuthology.provision.fog.smithi136:Node is ready
2024-03-14T02:57:32.274 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2024-03-14T02:57:32.288 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2024-03-14T02:57:32.288 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts
2024-03-14T02:57:32.346 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2024-03-14T02:57:32.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2024-03-14T02:57:32.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts
2024-03-14T02:57:32.497 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2024-03-14T02:57:32.568 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname
2024-03-14T02:57:32.639 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2024-03-14T02:57:32.709 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2024-03-14T02:57:32.767 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2024-03-14T02:57:32.767 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9"
2024-03-14T02:57:32.767 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2024-03-14T02:57:32.767 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2024-03-14T02:57:32.767 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9"
2024-03-14T02:57:32.767 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9"
2024-03-14T02:57:32.767 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T02:57:32.767 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2024-03-14T02:57:32.768 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon"
2024-03-14T02:57:32.768 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T02:57:32.768 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2024-03-14T02:57:32.768 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T02:57:32.768 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T02:57:32.768 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T02:57:32.768 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2024-03-14T02:57:32.769 DEBUG:teuthology.parallel:result is None
2024-03-14T02:57:32.981 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2024-03-14T02:57:32.981 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T02:57:33.006 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2024-03-14T02:57:33.006 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T02:57:33.030 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2024-03-14T02:57:33.030 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T02:57:33.048 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2024-03-14T02:57:33.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2024-03-14T02:57:33.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:57:33.135 DEBUG:teuthology.orchestra.run.smithi077:> true
2024-03-14T02:57:33.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com'
2024-03-14T02:57:33.300 DEBUG:teuthology.orchestra.run.smithi077:> uname -m
2024-03-14T02:57:33.355 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2024-03-14T02:57:33.356 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2024-03-14T02:57:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream"
2024-03-14T02:57:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9"
2024-03-14T02:57:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos"
2024-03-14T02:57:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora"
2024-03-14T02:57:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9"
2024-03-14T02:57:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9"
2024-03-14T02:57:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T02:57:33.411 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2024-03-14T02:57:33.411 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon"
2024-03-14T02:57:33.411 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T02:57:33.411 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/"
2024-03-14T02:57:33.411 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T02:57:33.411 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T02:57:33.411 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T02:57:33.411 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2024-03-14T02:57:33.430 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2024-03-14T02:57:33.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2024-03-14T02:57:33.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:57:33.524 DEBUG:teuthology.orchestra.run.smithi136:> true
2024-03-14T02:57:33.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com'
2024-03-14T02:57:33.588 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2024-03-14T02:57:33.646 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2024-03-14T02:57:33.646 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon"
2024-03-14T02:57:33.704 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T02:57:33.705 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2024-03-14T02:57:33.705 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T02:57:33.705 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T02:57:33.705 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T02:57:33.705 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2024-03-14T02:57:33.730 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2024-03-14T02:57:33.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2024-03-14T02:57:33.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T02:57:33.817 DEBUG:teuthology.orchestra.run.smithi169:> true
2024-03-14T02:57:33.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2024-03-14T02:57:33.944 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2024-03-14T02:57:33.998 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2024-03-14T02:57:33.999 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9"
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9"
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9"
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2024-03-14T02:57:34.053 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon"
2024-03-14T02:57:34.054 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-14T02:57:34.054 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2024-03-14T02:57:34.054 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T02:57:34.054 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-14T02:57:34.054 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T02:57:34.054 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2024-03-14T02:57:34.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T02:57:34.183 INFO:teuthology.dispatcher.supervisor:Running job 7599765
2024-03-14T02:57:34.183 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-14_02:47:14-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599765 --name pdonnell-2024-03-14_02:47:14-fs-wip-batrick-testing-20240310.014948-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/pdonnell-2024-03-14_02:47:14-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599765/orig.config.yaml
2024-03-14T02:57:34.187 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-14_02:47:14-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599765
2024-03-14T02:57:34.187 INFO:teuthology.dispatcher.supervisor:Job PID: 2148940
2024-03-14T02:57:34.187 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-14T02:59:34.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:01:34.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:03:34.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:05:34.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:07:34.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:09:35.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:11:35.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:13:35.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:15:35.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:17:35.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:19:35.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:21:36.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:23:36.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:25:36.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:27:36.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:29:36.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:31:36.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:33:37.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:35:37.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:37:37.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:39:37.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:41:37.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:43:37.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:45:38.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:47:38.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:49:38.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:51:38.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:53:38.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:55:38.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T03:55:39.028 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1