2024-03-19T06:45:27.258 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-19T06:45:27.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T06:45:27.424 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0751545f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f07525a6c10>, signals=[15])
2024-03-19T06:45:27.424 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging
2024-03-19T06:45:27.424 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T06:45:27.425 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-03-19T06:45:27.441 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2024-03-19T06:45:27.441 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T06:45:27.442 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2024-03-19T06:45:27.466 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging
2024-03-19T06:45:27.466 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server
2024-03-19T06:45:27.466 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-03-19T06:45:27.559 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T06:45:27.566 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T06:45:27.591 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10)
2024-03-19T06:45:27.604 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 9.stream
2024-03-19T06:45:27.626 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 9.stream
2024-03-19T06:45:27.646 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream
2024-03-19T06:45:27.837 INFO:teuthology.orchestra.console.smithi046:Power off
2024-03-19T06:45:27.837 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T06:45:27.859 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2024-03-19T06:45:27.859 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:27.875 INFO:teuthology.orchestra.console.smithi073:Power off
2024-03-19T06:45:27.875 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T06:45:27.889 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-03-19T06:45:27.896 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off
2024-03-19T06:45:27.896 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:27.912 INFO:teuthology.orchestra.console.smithi090:Power off
2024-03-19T06:45:27.913 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-19T06:45:27.920 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-03-19T06:45:27.934 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off
2024-03-19T06:45:27.934 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:27.955 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-19T06:45:27.990 INFO:teuthology.orchestra.console.smithi046:Power off completed
2024-03-19T06:45:28.022 INFO:teuthology.orchestra.console.smithi073:Power off completed
2024-03-19T06:45:28.091 INFO:teuthology.orchestra.console.smithi046:Power on
2024-03-19T06:45:28.092 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T06:45:28.123 INFO:teuthology.orchestra.console.smithi073:Power on
2024-03-19T06:45:28.123 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T06:45:28.139 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On
2024-03-19T06:45:28.140 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:28.148 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On
2024-03-19T06:45:28.149 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:28.162 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-03-19T06:45:28.171 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-03-19T06:45:31.957 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:32.067 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-19T06:45:32.163 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:32.172 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:32.272 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-03-19T06:45:32.281 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-03-19T06:45:32.373 INFO:teuthology.orchestra.console.smithi046:Power on completed
2024-03-19T06:45:32.474 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish
2024-03-19T06:45:36.070 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:36.178 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-19T06:45:36.282 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:36.391 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-03-19T06:45:36.491 INFO:teuthology.orchestra.console.smithi073:Power on completed
2024-03-19T06:45:36.592 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2024-03-19T06:45:40.182 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:40.292 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-19T06:45:40.392 INFO:teuthology.orchestra.console.smithi090:Power off completed
2024-03-19T06:45:40.493 INFO:teuthology.orchestra.console.smithi090:Power on
2024-03-19T06:45:40.493 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-19T06:45:40.514 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On
2024-03-19T06:45:40.515 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:40.536 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-19T06:45:44.538 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-19T06:45:44.647 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-19T06:45:44.748 INFO:teuthology.orchestra.console.smithi090:Power on completed
2024-03-19T06:45:44.849 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2024-03-19T06:48:07.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:10.718 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:48:16.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:18.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:19.774 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:48:21.630 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-19T06:48:25.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:27.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:28.830 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:48:30.686 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-19T06:48:34.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:36.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:37.886 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:48:39.742 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-19T06:48:43.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:45.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:46.946 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:48:48.802 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-19T06:48:52.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:54.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:48:56.033 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:48:57.886 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-19T06:49:01.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:02.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:03.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:04.254 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-19T06:49:05.118 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:49:06.946 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46
2024-03-19T06:49:10.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:11.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:12.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:13.314 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-19T06:49:19.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:22.398 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-19T06:49:28.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:29.630 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:49:31.486 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-19T06:49:35.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:37.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:38.686 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:49:40.542 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-19T06:49:44.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:46.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:47.742 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-03-19T06:49:49.598 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-19T06:49:53.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:54.015 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T06:49:54.016 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T06:49:55.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:49:58.658 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-19T06:50:04.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:50:09.439 INFO:teuthology.provision.fog.smithi073:Node is ready
2024-03-19T06:50:09.439 DEBUG:teuthology.orchestra.run.smithi073:> hostname
2024-03-19T06:50:09.457 INFO:teuthology.orchestra.run.smithi073.stdout:smithi046
2024-03-19T06:50:09.457 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi046 /etc/hosts
2024-03-19T06:50:09.514 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-03-19T06:50:09.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2024-03-19T06:50:09.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi046/smithi073/g' /etc/hosts
2024-03-19T06:50:09.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.46/172.21.15.73/g' /etc/hosts
2024-03-19T06:50:09.749 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi046/smithi073/g' /etc/hostname
2024-03-19T06:50:09.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2024-03-19T06:50:09.885 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2024-03-19T06:50:09.940 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2024-03-19T06:50:09.940 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9"
2024-03-19T06:50:09.940 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2024-03-19T06:50:09.940 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2024-03-19T06:50:09.940 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9"
2024-03-19T06:50:09.940 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9"
2024-03-19T06:50:09.941 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T06:50:09.941 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2024-03-19T06:50:09.941 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon"
2024-03-19T06:50:09.941 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T06:50:09.941 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2024-03-19T06:50:09.941 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T06:50:09.941 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T06:50:09.941 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T06:50:09.942 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2024-03-19T06:50:09.943 DEBUG:teuthology.parallel:result is None
2024-03-19T06:50:12.954 WARNING:teuthology.provision.fog.smithi046:timed out
2024-03-19T06:50:18.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:50:19.233 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T06:50:19.234 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T06:50:19.585 INFO:teuthology.provision.fog.smithi046:Node is ready
2024-03-19T06:50:19.585 DEBUG:teuthology.orchestra.run.smithi046:> hostname
2024-03-19T06:50:19.600 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com
2024-03-19T06:50:19.601 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts
2024-03-19T06:50:19.657 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-03-19T06:50:19.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-03-19T06:50:19.780 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts
2024-03-19T06:50:19.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts
2024-03-19T06:50:19.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname
2024-03-19T06:50:19.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-03-19T06:50:20.026 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-03-19T06:50:20.082 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream"
2024-03-19T06:50:20.082 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9"
2024-03-19T06:50:20.082 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos"
2024-03-19T06:50:20.082 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora"
2024-03-19T06:50:20.082 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9"
2024-03-19T06:50:20.082 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9"
2024-03-19T06:50:20.083 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T06:50:20.083 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31"
2024-03-19T06:50:20.083 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon"
2024-03-19T06:50:20.083 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T06:50:20.083 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/"
2024-03-19T06:50:20.083 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T06:50:20.083 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T06:50:20.083 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T06:50:20.083 INFO:teuthology.provision.fog.smithi046:Deploy complete!
2024-03-19T06:50:20.084 DEBUG:teuthology.parallel:result is None
2024-03-19T06:51:04.707 WARNING:teuthology.provision.fog.smithi090:timed out
2024-03-19T06:51:10.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:51:11.013 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-19T06:51:11.013 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-19T06:51:16.366 INFO:teuthology.provision.fog.smithi090:Node is ready
2024-03-19T06:51:16.367 DEBUG:teuthology.orchestra.run.smithi090:> hostname
2024-03-19T06:51:16.384 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2024-03-19T06:51:16.385 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts
2024-03-19T06:51:16.442 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2024-03-19T06:51:16.442 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-03-19T06:51:16.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts
2024-03-19T06:51:16.613 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts
2024-03-19T06:51:16.683 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname
2024-03-19T06:51:16.753 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-03-19T06:51:16.820 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-03-19T06:51:16.876 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-03-19T06:51:16.876 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9"
2024-03-19T06:51:16.876 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-03-19T06:51:16.876 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T06:51:16.877 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T06:51:16.877 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2024-03-19T06:51:16.878 DEBUG:teuthology.parallel:result is None
2024-03-19T06:51:17.092 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com
2024-03-19T06:51:17.092 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T06:51:17.118 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2024-03-19T06:51:17.118 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T06:51:17.142 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2024-03-19T06:51:17.142 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-19T06:51:17.160 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server
2024-03-19T06:51:17.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-03-19T06:51:17.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:51:17.266 DEBUG:teuthology.orchestra.run.smithi046:> true
2024-03-19T06:51:17.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-03-19T06:51:17.461 DEBUG:teuthology.orchestra.run.smithi046:> uname -m
2024-03-19T06:51:17.516 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64
2024-03-19T06:51:17.516 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-03-19T06:51:17.572 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream"
2024-03-19T06:51:17.572 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9"
2024-03-19T06:51:17.572 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos"
2024-03-19T06:51:17.572 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora"
2024-03-19T06:51:17.572 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9"
2024-03-19T06:51:17.572 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9"
2024-03-19T06:51:17.573 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T06:51:17.573 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31"
2024-03-19T06:51:17.573 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon"
2024-03-19T06:51:17.573 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T06:51:17.573 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/"
2024-03-19T06:51:17.573 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T06:51:17.573 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T06:51:17.573 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T06:51:17.574 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-03-19T06:51:17.593 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2024-03-19T06:51:17.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2024-03-19T06:51:17.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:51:17.684 DEBUG:teuthology.orchestra.run.smithi073:> true
2024-03-19T06:51:17.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com'
2024-03-19T06:51:17.853 DEBUG:teuthology.orchestra.run.smithi073:> uname -m
2024-03-19T06:51:17.907 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2024-03-19T06:51:17.908 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2024-03-19T06:51:17.962 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2024-03-19T06:51:17.962 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T06:51:17.963 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T06:51:17.964 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2024-03-19T06:51:17.992 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2024-03-19T06:51:17.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2024-03-19T06:51:17.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-19T06:51:18.086 DEBUG:teuthology.orchestra.run.smithi090:> true
2024-03-19T06:51:18.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com'
2024-03-19T06:51:18.159 DEBUG:teuthology.orchestra.run.smithi090:> uname -m
2024-03-19T06:51:18.215 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2024-03-19T06:51:18.215 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-19T06:51:18.271 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-03-19T06:51:18.272 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-19T06:51:18.272 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-19T06:51:18.272 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-19T06:51:18.272 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-03-19T06:51:18.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T06:51:18.404 INFO:teuthology.dispatcher.supervisor:Running job 7610566
2024-03-19T06:51:18.405 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610566 --name pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610566/orig.config.yaml
2024-03-19T06:51:18.408 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-19_04:56:42-fs-wip-batrick-testing-20240318.181317-distro-default-smithi/7610566
2024-03-19T06:51:18.408 INFO:teuthology.dispatcher.supervisor:Job PID: 564069
2024-03-19T06:51:18.408 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-19T06:53:18.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T06:55:18.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T06:57:18.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T06:59:19.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:01:19.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:03:19.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:05:19.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:07:19.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:09:19.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:11:20.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:13:20.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:15:20.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:17:20.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:19:20.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:21:20.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:23:21.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:25:21.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:27:21.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-19T07:27:21.605 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1