2024-03-24T21:28:37.292 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-24T21:28:37.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:28:37.468 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f42d5182f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f42d61e3c10>, signals=[15])
2024-03-24T21:28:37.468 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2024-03-24T21:28:37.469 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T21:28:37.469 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-03-24T21:28:37.486 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2024-03-24T21:28:37.486 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T21:28:37.486 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-03-24T21:28:37.510 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging
2024-03-24T21:28:37.510 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T21:28:37.511 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2024-03-24T21:28:37.617 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T21:28:37.636 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T21:28:37.639 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T21:28:37.655 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 9.stream
2024-03-24T21:28:37.690 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream
2024-03-24T21:28:37.695 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 9.stream
2024-03-24T21:28:37.930 INFO:teuthology.orchestra.console.smithi031:Power off
2024-03-24T21:28:37.930 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T21:28:37.944 INFO:teuthology.orchestra.console.smithi130:Power off
2024-03-24T21:28:37.944 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T21:28:37.956 INFO:teuthology.orchestra.console.smithi111:Power off
2024-03-24T21:28:37.956 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T21:28:37.964 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2024-03-24T21:28:37.965 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:37.974 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off
2024-03-24T21:28:37.974 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:37.982 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2024-03-24T21:28:37.982 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:37.990 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-24T21:28:37.995 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-03-24T21:28:38.005 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-24T21:28:41.994 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:42.001 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:42.008 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:42.104 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-24T21:28:42.110 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-03-24T21:28:42.117 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-24T21:28:46.106 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:46.113 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:46.120 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:46.216 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-24T21:28:46.222 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off
2024-03-24T21:28:46.231 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-24T21:28:46.317 INFO:teuthology.orchestra.console.smithi031:Power off completed
2024-03-24T21:28:46.322 INFO:teuthology.orchestra.console.smithi130:Power off completed
2024-03-24T21:28:46.332 INFO:teuthology.orchestra.console.smithi111:Power off completed
2024-03-24T21:28:46.418 INFO:teuthology.orchestra.console.smithi031:Power on
2024-03-24T21:28:46.419 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T21:28:46.426 INFO:teuthology.orchestra.console.smithi130:Power on
2024-03-24T21:28:46.427 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T21:28:46.434 INFO:teuthology.orchestra.console.smithi111:Power on
2024-03-24T21:28:46.434 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T21:28:46.442 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On
2024-03-24T21:28:46.443 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:46.452 DEBUG:teuthology.orchestra.console.smithi130:power on output: Chassis Power Control: Up/On
2024-03-24T21:28:46.452 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:46.460 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2024-03-24T21:28:46.461 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:46.469 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-24T21:28:46.473 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off
2024-03-24T21:28:46.481 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-24T21:28:50.474 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:50.481 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:50.488 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:50.584 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-24T21:28:50.590 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on
2024-03-24T21:28:50.596 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-24T21:28:50.691 INFO:teuthology.orchestra.console.smithi130:Power on completed
2024-03-24T21:28:50.791 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish
2024-03-24T21:28:54.589 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:54.597 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T21:28:54.698 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-24T21:28:54.772 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-24T21:28:54.799 INFO:teuthology.orchestra.console.smithi031:Power on completed
2024-03-24T21:28:54.873 INFO:teuthology.orchestra.console.smithi111:Power on completed
2024-03-24T21:28:54.900 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2024-03-24T21:28:54.975 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2024-03-24T21:31:10.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:13.694 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-24T21:31:19.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:21.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:22.750 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-24T21:31:24.706 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-03-24T21:31:28.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:30.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:31.814 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-24T21:31:33.762 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-03-24T21:31:37.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:39.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:40.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:40.894 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-24T21:31:42.850 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-03-24T21:31:43.838 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-24T21:31:46.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:48.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:49.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:49.950 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-24T21:31:51.938 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-03-24T21:31:52.894 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-24T21:31:55.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:57.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:58.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:31:59.006 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-24T21:32:01.027 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-03-24T21:32:01.950 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-24T21:32:05.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:32:07.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:32:07.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:32:10.110 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2024-03-24T21:32:11.006 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-24T21:32:16.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:32:17.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:32:20.066 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-24T21:32:26.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:32:29.154 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-24T21:32:35.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:32:38.238 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-24T21:32:44.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:32:47.294 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-24T21:32:53.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:33:05.022 WARNING:teuthology.provision.fog.smithi031:timed out
2024-03-24T21:33:11.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:33:11.273 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T21:33:11.273 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T21:33:11.578 INFO:teuthology.provision.fog.smithi031:Node is ready
2024-03-24T21:33:11.578 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2024-03-24T21:33:11.593 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2024-03-24T21:33:11.593 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts
2024-03-24T21:33:11.648 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2024-03-24T21:33:11.649 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-03-24T21:33:11.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts
2024-03-24T21:33:11.777 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts
2024-03-24T21:33:11.848 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname
2024-03-24T21:33:11.919 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-03-24T21:33:11.989 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-03-24T21:33:12.043 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2024-03-24T21:33:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T21:33:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T21:33:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T21:33:12.045 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2024-03-24T21:33:12.047 DEBUG:teuthology.parallel:result is None
2024-03-24T21:33:16.121 WARNING:teuthology.provision.fog.smithi130:timed out
2024-03-24T21:33:22.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:33:22.365 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T21:33:22.365 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T21:33:22.695 INFO:teuthology.provision.fog.smithi130:Node is ready
2024-03-24T21:33:22.695 DEBUG:teuthology.orchestra.run.smithi130:> hostname
2024-03-24T21:33:22.710 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com
2024-03-24T21:33:22.710 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi130.front.sepia.ceph.com /etc/hosts
2024-03-24T21:33:22.765 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130
2024-03-24T21:33:22.766 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2024-03-24T21:33:22.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hosts
2024-03-24T21:33:22.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts
2024-03-24T21:33:22.979 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hostname
2024-03-24T21:33:23.046 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2024-03-24T21:33:23.112 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2024-03-24T21:33:23.166 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream"
2024-03-24T21:33:23.166 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9"
2024-03-24T21:33:23.166 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T21:33:23.167 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T21:33:23.167 INFO:teuthology.provision.fog.smithi130:Deploy complete!
2024-03-24T21:33:23.168 DEBUG:teuthology.parallel:result is None
2024-03-24T21:33:53.327 WARNING:teuthology.provision.fog.smithi111:timed out
2024-03-24T21:33:59.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:33:59.609 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T21:33:59.609 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T21:33:59.945 INFO:teuthology.provision.fog.smithi111:Node is ready
2024-03-24T21:33:59.945 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2024-03-24T21:33:59.960 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2024-03-24T21:33:59.961 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2024-03-24T21:34:00.017 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2024-03-24T21:34:00.018 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-03-24T21:34:00.116 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2024-03-24T21:34:00.145 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2024-03-24T21:34:00.214 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2024-03-24T21:34:00.282 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-03-24T21:34:00.350 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-03-24T21:34:00.404 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-03-24T21:34:00.404 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T21:34:00.405 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T21:34:00.406 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2024-03-24T21:34:00.406 DEBUG:teuthology.parallel:result is None
2024-03-24T21:34:00.659 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2024-03-24T21:34:00.659 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T21:34:00.684 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2024-03-24T21:34:00.684 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T21:34:00.717 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com
2024-03-24T21:34:00.718 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T21:34:00.735 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2024-03-24T21:34:00.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-03-24T21:34:00.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:34:00.839 DEBUG:teuthology.orchestra.run.smithi031:> true
2024-03-24T21:34:01.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-03-24T21:34:01.021 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2024-03-24T21:34:01.076 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2024-03-24T21:34:01.076 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-03-24T21:34:01.130 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T21:34:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T21:34:01.132 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-03-24T21:34:01.151 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2024-03-24T21:34:01.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-03-24T21:34:01.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:34:01.240 DEBUG:teuthology.orchestra.run.smithi111:> true
2024-03-24T21:34:01.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-03-24T21:34:01.310 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2024-03-24T21:34:01.366 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2024-03-24T21:34:01.366 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-03-24T21:34:01.422 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-03-24T21:34:01.422 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-03-24T21:34:01.422 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T21:34:01.423 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T21:34:01.424 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-03-24T21:34:01.443 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server
2024-03-24T21:34:01.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com'
2024-03-24T21:34:01.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T21:34:01.534 DEBUG:teuthology.orchestra.run.smithi130:> true
2024-03-24T21:34:01.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com'
2024-03-24T21:34:01.705 DEBUG:teuthology.orchestra.run.smithi130:> uname -m
2024-03-24T21:34:01.760 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64
2024-03-24T21:34:01.761 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2024-03-24T21:34:01.816 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream"
2024-03-24T21:34:01.816 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9"
2024-03-24T21:34:01.816 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos"
2024-03-24T21:34:01.816 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora"
2024-03-24T21:34:01.817 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9"
2024-03-24T21:34:01.817 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9"
2024-03-24T21:34:01.817 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T21:34:01.817 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2024-03-24T21:34:01.817 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon"
2024-03-24T21:34:01.817 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T21:34:01.818 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/"
2024-03-24T21:34:01.818 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T21:34:01.818 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T21:34:01.818 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T21:34:01.819 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2024-03-24T21:34:01.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:34:01.941 INFO:teuthology.dispatcher.supervisor:Running job 7619935
2024-03-24T21:34:01.941 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7619935 --name teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7619935/orig.config.yaml
2024-03-24T21:34:01.945 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-24_21:24:02-fs-squid-distro-default-smithi/7619935
2024-03-24T21:34:01.945 INFO:teuthology.dispatcher.supervisor:Job PID: 3231441
2024-03-24T21:34:01.945 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-24T21:36:02.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:38:02.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:40:02.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:42:02.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:44:02.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:46:02.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:48:03.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:50:03.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:52:03.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:54:03.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:56:03.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T21:58:03.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:00:03.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:02:04.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:04:04.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:06:04.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:08:04.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:08:04.756 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1