2024-03-17T23:28:46.219 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-17T23:28:46.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T23:28:46.396 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7fc65f8f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7fc7659c10>, signals=[15])
2024-03-17T23:28:46.397 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging
2024-03-17T23:28:46.397 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T23:28:46.397 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2024-03-17T23:28:46.419 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2024-03-17T23:28:46.419 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T23:28:46.419 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-03-17T23:28:46.443 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2024-03-17T23:28:46.443 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T23:28:46.443 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-03-17T23:28:46.544 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T23:28:46.571 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T23:28:46.580 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T23:28:46.585 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream
2024-03-17T23:28:46.622 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 9.stream
2024-03-17T23:28:46.625 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream
2024-03-17T23:28:46.845 INFO:teuthology.orchestra.console.smithi040:Power off
2024-03-17T23:28:46.846 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T23:28:46.867 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2024-03-17T23:28:46.867 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:46.888 INFO:teuthology.orchestra.console.smithi104:Power off
2024-03-17T23:28:46.888 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T23:28:46.897 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-03-17T23:28:46.903 INFO:teuthology.orchestra.console.smithi119:Power off
2024-03-17T23:28:46.904 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T23:28:46.913 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2024-03-17T23:28:46.914 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:46.925 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-03-17T23:28:46.925 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:46.936 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-03-17T23:28:46.945 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-17T23:28:46.999 INFO:teuthology.orchestra.console.smithi040:Power off completed
2024-03-17T23:28:47.099 INFO:teuthology.orchestra.console.smithi040:Power on
2024-03-17T23:28:47.100 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T23:28:47.121 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On
2024-03-17T23:28:47.121 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:47.146 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-03-17T23:28:50.941 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:50.948 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:51.051 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-03-17T23:28:51.056 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-17T23:28:51.147 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:51.256 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-03-17T23:28:55.055 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:55.062 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:55.165 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-03-17T23:28:55.171 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-17T23:28:55.257 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:55.273 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-03-17T23:28:55.367 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-03-17T23:28:55.373 INFO:teuthology.orchestra.console.smithi119:Power on
2024-03-17T23:28:55.373 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T23:28:55.396 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2024-03-17T23:28:55.396 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:55.418 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-17T23:28:55.468 INFO:teuthology.orchestra.console.smithi040:Power on completed
2024-03-17T23:28:55.569 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2024-03-17T23:28:59.169 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:59.278 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-03-17T23:28:59.379 INFO:teuthology.orchestra.console.smithi104:Power off completed
2024-03-17T23:28:59.419 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:59.479 INFO:teuthology.orchestra.console.smithi104:Power on
2024-03-17T23:28:59.480 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T23:28:59.500 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2024-03-17T23:28:59.501 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:28:59.521 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-03-17T23:28:59.528 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-17T23:29:03.524 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:29:03.532 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:29:03.634 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-03-17T23:29:03.639 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-17T23:29:03.736 INFO:teuthology.orchestra.console.smithi104:Power on completed
2024-03-17T23:29:03.740 INFO:teuthology.orchestra.console.smithi119:Power on completed
2024-03-17T23:29:03.837 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2024-03-17T23:29:03.841 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2024-03-17T23:31:26.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:29.346 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-17T23:31:34.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:34.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:35.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:37.630 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-17T23:31:37.631 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-17T23:31:38.402 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-17T23:31:43.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:43.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:44.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:46.691 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-17T23:31:46.722 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-17T23:31:47.490 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-17T23:31:52.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:52.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:53.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:31:55.774 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-17T23:31:55.774 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-17T23:31:56.542 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-17T23:32:01.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:01.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:02.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:04.834 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-17T23:32:04.835 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-17T23:32:05.598 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-17T23:32:10.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:10.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:11.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:13.918 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-17T23:32:13.919 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-17T23:32:14.658 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-17T23:32:19.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:19.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:20.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:22.978 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-17T23:32:23.006 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-03-17T23:32:28.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:29.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:32:32.062 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-17T23:32:38.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:33:20.703 WARNING:teuthology.provision.fog.smithi040:timed out
2024-03-17T23:33:26.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:33:26.972 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T23:33:26.973 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T23:33:27.308 INFO:teuthology.provision.fog.smithi040:Node is ready
2024-03-17T23:33:27.308 DEBUG:teuthology.orchestra.run.smithi040:> hostname
2024-03-17T23:33:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2024-03-17T23:33:27.323 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts
2024-03-17T23:33:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2024-03-17T23:33:27.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2024-03-17T23:33:27.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts
2024-03-17T23:33:27.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts
2024-03-17T23:33:27.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname
2024-03-17T23:33:27.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2024-03-17T23:33:27.737 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:33:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:33:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:33:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:33:27.794 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2024-03-17T23:33:27.796 DEBUG:teuthology.parallel:result is None
2024-03-17T23:33:29.010 WARNING:teuthology.provision.fog.smithi104:timed out
2024-03-17T23:33:35.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:33:35.255 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T23:33:35.256 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T23:33:35.578 INFO:teuthology.provision.fog.smithi104:Node is ready
2024-03-17T23:33:35.578 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2024-03-17T23:33:35.592 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2024-03-17T23:33:35.592 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts
2024-03-17T23:33:35.647 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2024-03-17T23:33:35.648 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-03-17T23:33:35.773 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts
2024-03-17T23:33:35.801 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2024-03-17T23:33:35.869 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname
2024-03-17T23:33:35.936 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-03-17T23:33:36.002 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-03-17T23:33:36.057 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2024-03-17T23:33:36.057 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9"
2024-03-17T23:33:36.057 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2024-03-17T23:33:36.057 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:33:36.057 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:33:36.058 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:33:36.058 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2024-03-17T23:33:36.059 DEBUG:teuthology.parallel:result is None
2024-03-17T23:33:38.072 WARNING:teuthology.provision.fog.smithi119:timed out
2024-03-17T23:33:44.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:33:44.287 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T23:33:44.287 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T23:33:44.603 INFO:teuthology.provision.fog.smithi119:Node is ready
2024-03-17T23:33:44.603 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2024-03-17T23:33:44.617 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2024-03-17T23:33:44.617 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2024-03-17T23:33:44.673 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2024-03-17T23:33:44.673 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-03-17T23:33:44.796 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2024-03-17T23:33:44.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2024-03-17T23:33:44.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2024-03-17T23:33:44.959 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-03-17T23:33:45.025 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-03-17T23:33:45.079 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:33:45.080 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:33:45.081 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:33:45.081 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2024-03-17T23:33:45.081 DEBUG:teuthology.parallel:result is None
2024-03-17T23:33:45.331 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2024-03-17T23:33:45.332 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T23:33:45.352 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2024-03-17T23:33:45.353 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T23:33:45.377 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2024-03-17T23:33:45.377 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T23:33:45.403 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2024-03-17T23:33:45.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2024-03-17T23:33:45.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:33:45.516 DEBUG:teuthology.orchestra.run.smithi040:> true
2024-03-17T23:33:45.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com'
2024-03-17T23:33:45.693 DEBUG:teuthology.orchestra.run.smithi040:> uname -m
2024-03-17T23:33:45.749 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2024-03-17T23:33:45.749 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:33:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:33:45.805 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:33:45.805 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:33:45.805 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2024-03-17T23:33:45.827 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2024-03-17T23:33:45.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-03-17T23:33:45.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:33:45.919 DEBUG:teuthology.orchestra.run.smithi104:> true
2024-03-17T23:33:45.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-03-17T23:33:45.986 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2024-03-17T23:33:46.043 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2024-03-17T23:33:46.044 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-03-17T23:33:46.100 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2024-03-17T23:33:46.100 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9"
2024-03-17T23:33:46.100 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2024-03-17T23:33:46.100 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:33:46.100 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9"
2024-03-17T23:33:46.100 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:33:46.101 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:33:46.101 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-03-17T23:33:46.101 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:33:46.101 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:33:46.101 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:33:46.101 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:33:46.101 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:33:46.101 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:33:46.101 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-03-17T23:33:46.119 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2024-03-17T23:33:46.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-03-17T23:33:46.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:33:46.208 DEBUG:teuthology.orchestra.run.smithi119:> true
2024-03-17T23:33:46.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-03-17T23:33:46.280 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2024-03-17T23:33:46.334 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2024-03-17T23:33:46.334 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-03-17T23:33:46.388 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:33:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:33:46.390 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:33:46.390 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:33:46.390 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:33:46.390 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:33:46.390 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-03-17T23:33:46.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T23:33:46.506 INFO:teuthology.dispatcher.supervisor:Running job 7608492
2024-03-17T23:33:46.506 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608492 --name pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608492/orig.config.yaml
2024-03-17T23:33:46.509 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608492
2024-03-17T23:33:46.510 INFO:teuthology.dispatcher.supervisor:Job PID: 892955
2024-03-17T23:33:46.510 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-17T23:35:46.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T23:35:46.690 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1