2024-03-28T15:40:48.218 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-28T15:40:48.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T15:40:48.435 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f004b047f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f004c0a7c10>, signals=[15])
2024-03-28T15:40:48.436 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2024-03-28T15:40:48.436 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T15:40:48.436 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2024-03-28T15:40:48.458 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2024-03-28T15:40:48.458 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T15:40:48.458 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-03-28T15:40:48.483 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2024-03-28T15:40:48.483 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T15:40:48.483 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-03-28T15:40:48.580 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T15:40:48.600 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T15:40:48.622 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T15:40:48.625 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 9.stream
2024-03-28T15:40:48.643 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 9.stream
2024-03-28T15:40:48.658 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 9.stream
2024-03-28T15:40:48.848 INFO:teuthology.orchestra.console.smithi073:Power off
2024-03-28T15:40:48.848 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T15:40:48.864 INFO:teuthology.orchestra.console.smithi100:Power off
2024-03-28T15:40:48.864 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T15:40:48.873 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off
2024-03-28T15:40:48.873 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:48.889 INFO:teuthology.orchestra.console.smithi107:Power off
2024-03-28T15:40:48.890 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T15:40:48.900 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-03-28T15:40:48.901 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:48.910 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-03-28T15:40:48.914 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2024-03-28T15:40:48.914 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:48.928 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-28T15:40:48.938 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-03-28T15:40:49.039 INFO:teuthology.orchestra.console.smithi107:Power off completed
2024-03-28T15:40:49.140 INFO:teuthology.orchestra.console.smithi107:Power on
2024-03-28T15:40:49.140 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T15:40:49.162 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On
2024-03-28T15:40:49.162 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:49.189 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-03-28T15:40:52.914 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:52.929 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:53.024 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-03-28T15:40:53.039 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-28T15:40:53.190 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:53.299 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-03-28T15:40:53.400 INFO:teuthology.orchestra.console.smithi107:Power on completed
2024-03-28T15:40:53.501 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2024-03-28T15:40:57.026 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:57.039 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:40:57.135 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-03-28T15:40:57.147 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-28T15:41:01.138 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:41:01.148 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:41:01.248 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-03-28T15:41:01.258 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-28T15:41:01.350 INFO:teuthology.orchestra.console.smithi073:Power off completed
2024-03-28T15:41:01.359 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-03-28T15:41:01.452 INFO:teuthology.orchestra.console.smithi073:Power on
2024-03-28T15:41:01.452 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T15:41:01.460 INFO:teuthology.orchestra.console.smithi100:Power on
2024-03-28T15:41:01.461 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T15:41:01.478 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On
2024-03-28T15:41:01.478 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:41:01.487 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2024-03-28T15:41:01.487 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:41:01.500 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-03-28T15:41:01.510 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-03-28T15:41:05.503 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:41:05.511 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T15:41:05.613 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-03-28T15:41:05.619 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-03-28T15:41:05.714 INFO:teuthology.orchestra.console.smithi073:Power on completed
2024-03-28T15:41:05.720 INFO:teuthology.orchestra.console.smithi100:Power on completed
2024-03-28T15:41:05.815 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2024-03-28T15:41:05.821 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2024-03-28T15:43:36.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:43:39.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:43:39.678 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-28T15:43:42.277 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-28T15:43:45.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:43:48.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:43:48.734 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-28T15:43:51.358 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-28T15:43:51.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:43:54.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:43:54.750 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-28T15:43:57.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:43:57.790 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-28T15:44:00.414 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-28T15:44:00.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:03.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:03.810 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-28T15:44:06.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:06.846 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-28T15:44:09.470 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-28T15:44:09.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:12.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:12.862 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-28T15:44:15.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:15.906 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-28T15:44:18.526 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-28T15:44:18.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:21.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:21.922 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-28T15:44:24.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:24.990 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-28T15:44:27.586 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-03-28T15:44:27.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:30.978 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-28T15:44:30.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:33.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:34.046 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-28T15:44:36.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:40.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:44:40.062 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-03-28T15:44:46.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:45:33.639 WARNING:teuthology.provision.fog.smithi107:timed out
2024-03-28T15:45:39.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:45:40.025 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T15:45:40.026 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T15:45:40.052 WARNING:teuthology.provision.fog.smithi073:timed out
2024-03-28T15:45:40.333 INFO:teuthology.provision.fog.smithi107:Node is ready
2024-03-28T15:45:40.333 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2024-03-28T15:45:40.348 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2024-03-28T15:45:40.349 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts
2024-03-28T15:45:40.403 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2024-03-28T15:45:40.404 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-03-28T15:45:40.512 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts
2024-03-28T15:45:40.540 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts
2024-03-28T15:45:40.606 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname
2024-03-28T15:45:40.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-03-28T15:45:40.744 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-03-28T15:45:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2024-03-28T15:45:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2024-03-28T15:45:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2024-03-28T15:45:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2024-03-28T15:45:40.800 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2024-03-28T15:45:40.800 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2024-03-28T15:45:40.800 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T15:45:40.800 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-03-28T15:45:40.800 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2024-03-28T15:45:40.800 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T15:45:40.800 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2024-03-28T15:45:40.801 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T15:45:40.801 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T15:45:40.801 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T15:45:40.802 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2024-03-28T15:45:40.804 DEBUG:teuthology.parallel:result is None
2024-03-28T15:45:46.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:45:46.071 WARNING:teuthology.provision.fog.smithi100:timed out
2024-03-28T15:45:46.316 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T15:45:46.317 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T15:45:46.639 INFO:teuthology.provision.fog.smithi073:Node is ready
2024-03-28T15:45:46.640 DEBUG:teuthology.orchestra.run.smithi073:> hostname
2024-03-28T15:45:46.654 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2024-03-28T15:45:46.655 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts
2024-03-28T15:45:46.709 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2024-03-28T15:45:46.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2024-03-28T15:45:46.830 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts
2024-03-28T15:45:46.858 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts
2024-03-28T15:45:46.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname
2024-03-28T15:45:46.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2024-03-28T15:45:47.062 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2024-03-28T15:45:47.116 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T15:45:47.117 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T15:45:47.118 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2024-03-28T15:45:47.118 DEBUG:teuthology.parallel:result is None
2024-03-28T15:45:52.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:45:52.350 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T15:45:52.351 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T15:45:52.679 INFO:teuthology.provision.fog.smithi100:Node is ready
2024-03-28T15:45:52.679 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2024-03-28T15:45:52.694 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2024-03-28T15:45:52.694 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts
2024-03-28T15:45:52.750 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2024-03-28T15:45:52.750 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-03-28T15:45:52.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts
2024-03-28T15:45:52.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2024-03-28T15:45:52.955 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname
2024-03-28T15:45:53.022 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-03-28T15:45:53.088 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-03-28T15:45:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2024-03-28T15:45:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2024-03-28T15:45:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2024-03-28T15:45:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2024-03-28T15:45:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2024-03-28T15:45:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2024-03-28T15:45:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T15:45:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2024-03-28T15:45:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2024-03-28T15:45:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T15:45:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2024-03-28T15:45:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T15:45:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T15:45:53.145 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T15:45:53.145 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2024-03-28T15:45:53.146 DEBUG:teuthology.parallel:result is None
2024-03-28T15:45:53.394 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2024-03-28T15:45:53.395 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T15:45:53.414 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2024-03-28T15:45:53.414 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T15:45:53.431 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2024-03-28T15:45:53.431 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T15:45:53.449 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2024-03-28T15:45:53.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2024-03-28T15:45:53.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:45:53.539 DEBUG:teuthology.orchestra.run.smithi073:> true
2024-03-28T15:45:53.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com'
2024-03-28T15:45:53.606 DEBUG:teuthology.orchestra.run.smithi073:> uname -m
2024-03-28T15:45:53.665 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2024-03-28T15:45:53.665 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2024-03-28T15:45:53.725 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2024-03-28T15:45:53.725 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9"
2024-03-28T15:45:53.725 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2024-03-28T15:45:53.725 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2024-03-28T15:45:53.725 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9"
2024-03-28T15:45:53.725 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9"
2024-03-28T15:45:53.725 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T15:45:53.725 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2024-03-28T15:45:53.726 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon"
2024-03-28T15:45:53.726 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T15:45:53.726 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2024-03-28T15:45:53.726 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T15:45:53.726 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T15:45:53.726 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T15:45:53.726 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2024-03-28T15:45:53.756 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2024-03-28T15:45:53.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-03-28T15:45:53.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:45:53.845 DEBUG:teuthology.orchestra.run.smithi100:> true
2024-03-28T15:45:53.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com'
2024-03-28T15:45:53.912 DEBUG:teuthology.orchestra.run.smithi100:> uname -m
2024-03-28T15:45:53.966 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2024-03-28T15:45:53.967 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-03-28T15:45:54.020 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream"
2024-03-28T15:45:54.020 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9"
2024-03-28T15:45:54.020 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2024-03-28T15:45:54.020 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2024-03-28T15:45:54.020 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T15:45:54.021 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T15:45:54.022 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-03-28T15:45:54.039 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2024-03-28T15:45:54.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-03-28T15:45:54.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T15:45:54.126 DEBUG:teuthology.orchestra.run.smithi107:> true
2024-03-28T15:45:54.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-03-28T15:45:54.292 DEBUG:teuthology.orchestra.run.smithi107:> uname -m
2024-03-28T15:45:54.346 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2024-03-28T15:45:54.346 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-03-28T15:45:54.400 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2024-03-28T15:45:54.400 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T15:45:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T15:45:54.402 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-03-28T15:45:54.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T15:45:54.518 INFO:teuthology.dispatcher.supervisor:Running job 7625330
2024-03-28T15:45:54.518 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625330 --name mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625330/orig.config.yaml
2024-03-28T15:45:54.521 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625330
2024-03-28T15:45:54.521 INFO:teuthology.dispatcher.supervisor:Job PID: 980067
2024-03-28T15:45:54.521 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-28T15:47:54.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T15:49:54.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T15:51:54.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T15:53:55.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T15:55:55.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T15:57:55.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T15:59:55.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:01:55.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:03:56.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:05:56.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:07:56.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:09:56.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:11:56.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:13:56.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:15:57.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:17:57.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:19:57.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:21:57.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:23:57.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:25:57.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:27:57.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:29:58.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:31:58.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:33:58.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:35:58.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:37:58.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:39:58.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:39:59.066 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1