2024-04-01T16:08:34.497 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-01T16:08:34.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:08:34.670 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcdf17e5f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcdf2846c10>, signals=[15])
2024-04-01T16:08:34.671 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging
2024-04-01T16:08:34.671 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T16:08:34.671 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2024-04-01T16:08:34.695 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging
2024-04-01T16:08:34.695 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T16:08:34.695 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-04-01T16:08:34.719 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2024-04-01T16:08:34.719 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T16:08:34.719 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2024-04-01T16:08:34.821 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T16:08:34.840 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T16:08:34.854 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T16:08:34.868 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 9.stream
2024-04-01T16:08:34.881 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 9.stream
2024-04-01T16:08:34.899 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream
2024-04-01T16:08:35.087 INFO:teuthology.orchestra.console.smithi094:Power off
2024-04-01T16:08:35.088 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T16:08:35.101 INFO:teuthology.orchestra.console.smithi165:Power off
2024-04-01T16:08:35.101 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T16:08:35.114 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2024-04-01T16:08:35.115 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:35.123 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off
2024-04-01T16:08:35.123 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:35.139 INFO:teuthology.orchestra.console.smithi183:Power off
2024-04-01T16:08:35.139 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T16:08:35.148 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-04-01T16:08:35.148 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2024-04-01T16:08:35.160 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2024-04-01T16:08:35.160 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:35.180 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-04-01T16:08:39.152 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:39.161 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:39.181 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:39.263 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-04-01T16:08:39.269 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2024-04-01T16:08:39.289 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-04-01T16:08:43.267 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:43.275 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:43.290 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:43.376 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-04-01T16:08:43.382 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2024-04-01T16:08:43.398 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-04-01T16:08:43.483 INFO:teuthology.orchestra.console.smithi094:Power off completed
2024-04-01T16:08:43.584 INFO:teuthology.orchestra.console.smithi094:Power on
2024-04-01T16:08:43.584 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T16:08:43.606 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On
2024-04-01T16:08:43.607 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:43.627 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2024-04-01T16:08:47.381 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:47.399 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:47.491 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-04-01T16:08:47.507 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-04-01T16:08:47.593 INFO:teuthology.orchestra.console.smithi165:Power off completed
2024-04-01T16:08:47.608 INFO:teuthology.orchestra.console.smithi183:Power off completed
2024-04-01T16:08:47.628 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:47.693 INFO:teuthology.orchestra.console.smithi165:Power on
2024-04-01T16:08:47.694 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T16:08:47.709 INFO:teuthology.orchestra.console.smithi183:Power on
2024-04-01T16:08:47.709 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T16:08:47.718 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On
2024-04-01T16:08:47.718 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:47.731 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On
2024-04-01T16:08:47.731 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:47.739 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2024-04-01T16:08:47.740 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-04-01T16:08:47.753 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-04-01T16:08:51.742 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:51.749 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:51.757 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T16:08:51.852 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2024-04-01T16:08:51.858 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-04-01T16:08:51.865 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-04-01T16:08:51.952 INFO:teuthology.orchestra.console.smithi094:Power on completed
2024-04-01T16:08:51.959 INFO:teuthology.orchestra.console.smithi165:Power on completed
2024-04-01T16:08:51.966 INFO:teuthology.orchestra.console.smithi183:Power on completed
2024-04-01T16:08:52.054 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish
2024-04-01T16:08:52.060 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2024-04-01T16:08:52.067 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2024-04-01T16:11:22.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:25.886 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-04-01T16:11:31.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:34.942 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-04-01T16:11:37.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:37.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:40.926 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-04-01T16:11:40.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:40.958 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-01T16:11:43.998 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-04-01T16:11:46.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:46.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:49.982 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-04-01T16:11:50.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:50.014 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-01T16:11:53.054 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-04-01T16:11:55.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:56.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:59.042 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-04-01T16:11:59.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:11:59.070 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-01T16:12:02.110 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-04-01T16:12:05.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:05.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:08.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:08.126 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-04-01T16:12:08.126 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-01T16:12:11.166 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2024-04-01T16:12:14.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:14.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:17.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:17.182 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-04-01T16:12:17.182 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-01T16:12:23.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:23.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:26.270 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-04-01T16:12:26.271 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-04-01T16:12:32.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:12:32.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:13:17.215 WARNING:teuthology.provision.fog.smithi094:timed out
2024-04-01T16:13:23.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:13:23.487 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T16:13:23.487 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T16:13:23.819 INFO:teuthology.provision.fog.smithi094:Node is ready
2024-04-01T16:13:23.819 DEBUG:teuthology.orchestra.run.smithi094:> hostname
2024-04-01T16:13:23.833 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com
2024-04-01T16:13:23.834 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts
2024-04-01T16:13:23.889 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094
2024-04-01T16:13:23.889 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2024-04-01T16:13:24.010 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts
2024-04-01T16:13:24.037 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts
2024-04-01T16:13:24.105 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname
2024-04-01T16:13:24.172 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2024-04-01T16:13:24.238 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2024-04-01T16:13:24.293 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream"
2024-04-01T16:13:24.293 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9"
2024-04-01T16:13:24.293 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos"
2024-04-01T16:13:24.293 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora"
2024-04-01T16:13:24.293 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9"
2024-04-01T16:13:24.293 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9"
2024-04-01T16:13:24.293 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T16:13:24.293 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2024-04-01T16:13:24.294 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon"
2024-04-01T16:13:24.294 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T16:13:24.294 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/"
2024-04-01T16:13:24.294 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T16:13:24.294 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T16:13:24.294 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T16:13:24.295 INFO:teuthology.provision.fog.smithi094:Deploy complete!
2024-04-01T16:13:24.296 DEBUG:teuthology.parallel:result is None
2024-04-01T16:13:32.283 WARNING:teuthology.provision.fog.smithi183:timed out
2024-04-01T16:13:32.284 WARNING:teuthology.provision.fog.smithi165:timed out
2024-04-01T16:13:38.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:13:38.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:13:38.548 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T16:13:38.549 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T16:13:38.606 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T16:13:38.606 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T16:13:38.890 INFO:teuthology.provision.fog.smithi165:Node is ready
2024-04-01T16:13:38.890 DEBUG:teuthology.orchestra.run.smithi165:> hostname
2024-04-01T16:13:38.904 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2024-04-01T16:13:38.904 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165.front.sepia.ceph.com /etc/hosts
2024-04-01T16:13:38.913 INFO:teuthology.provision.fog.smithi183:Node is ready
2024-04-01T16:13:38.913 DEBUG:teuthology.orchestra.run.smithi183:> hostname
2024-04-01T16:13:38.927 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2024-04-01T16:13:38.928 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts
2024-04-01T16:13:38.959 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2024-04-01T16:13:38.960 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-04-01T16:13:38.983 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2024-04-01T16:13:38.984 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2024-04-01T16:13:39.057 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hosts
2024-04-01T16:13:39.084 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts
2024-04-01T16:13:39.090 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts
2024-04-01T16:13:39.118 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts
2024-04-01T16:13:39.152 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hostname
2024-04-01T16:13:39.185 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname
2024-04-01T16:13:39.219 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-04-01T16:13:39.252 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2024-04-01T16:13:39.285 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-04-01T16:13:39.318 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2024-04-01T16:13:39.340 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-04-01T16:13:39.340 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9"
2024-04-01T16:13:39.340 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-04-01T16:13:39.340 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-04-01T16:13:39.340 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9"
2024-04-01T16:13:39.340 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9"
2024-04-01T16:13:39.341 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T16:13:39.341 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-04-01T16:13:39.341 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon"
2024-04-01T16:13:39.341 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T16:13:39.341 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-04-01T16:13:39.341 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T16:13:39.341 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T16:13:39.341 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T16:13:39.342 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2024-04-01T16:13:39.342 DEBUG:teuthology.parallel:result is None
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2024-04-01T16:13:39.373 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T16:13:39.374 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2024-04-01T16:13:39.374 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T16:13:39.374 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T16:13:39.374 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T16:13:39.374 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2024-04-01T16:13:39.375 DEBUG:teuthology.parallel:result is None
2024-04-01T16:13:39.615 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com
2024-04-01T16:13:39.616 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T16:13:39.644 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2024-04-01T16:13:39.644 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T16:13:39.669 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2024-04-01T16:13:39.669 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T16:13:39.687 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server
2024-04-01T16:13:39.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com'
2024-04-01T16:13:39.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:13:39.778 DEBUG:teuthology.orchestra.run.smithi094:> true
2024-04-01T16:13:39.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com'
2024-04-01T16:13:39.944 DEBUG:teuthology.orchestra.run.smithi094:> uname -m
2024-04-01T16:13:39.999 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64
2024-04-01T16:13:39.999 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2024-04-01T16:13:40.053 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream"
2024-04-01T16:13:40.053 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T16:13:40.054 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T16:13:40.055 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2024-04-01T16:13:40.078 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2024-04-01T16:13:40.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-04-01T16:13:40.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:13:40.207 DEBUG:teuthology.orchestra.run.smithi165:> true
2024-04-01T16:13:40.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-04-01T16:13:40.272 DEBUG:teuthology.orchestra.run.smithi165:> uname -m
2024-04-01T16:13:40.326 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2024-04-01T16:13:40.327 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-04-01T16:13:40.380 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T16:13:40.381 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T16:13:40.382 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-04-01T16:13:40.403 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2024-04-01T16:13:40.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2024-04-01T16:13:40.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T16:13:40.490 DEBUG:teuthology.orchestra.run.smithi183:> true
2024-04-01T16:13:40.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com'
2024-04-01T16:13:40.557 DEBUG:teuthology.orchestra.run.smithi183:> uname -m
2024-04-01T16:13:40.612 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2024-04-01T16:13:40.612 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T16:13:40.668 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2024-04-01T16:13:40.669 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T16:13:40.669 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T16:13:40.669 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T16:13:40.669 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2024-04-01T16:13:40.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:13:40.790 INFO:teuthology.dispatcher.supervisor:Running job 7633964
2024-04-01T16:13:40.790 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633964 --name vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633964/orig.config.yaml
2024-04-01T16:13:40.793 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633964
2024-04-01T16:13:40.793 INFO:teuthology.dispatcher.supervisor:Job PID: 3330740
2024-04-01T16:13:40.793 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-01T16:15:40.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:17:41.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:19:41.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:21:41.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:23:41.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:25:41.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:27:41.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:29:42.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:31:42.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T16:31:42.311 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1