2024-04-02T12:44:39.832 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-02T12:44:39.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T12:44:40.097 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff485858f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff4868b9c10>, signals=[15])
2024-04-02T12:44:40.098 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2024-04-02T12:44:40.098 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2024-04-02T12:44:40.098 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2024-04-02T12:44:40.255 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_9.stream (ID 10)
2024-04-02T12:44:40.315 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 9.stream
2024-04-02T12:44:40.668 INFO:teuthology.orchestra.console.smithi167:Power off
2024-04-02T12:44:40.668 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-02T12:44:40.696 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off
2024-04-02T12:44:40.697 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T12:44:40.722 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2024-04-02T12:44:40.823 INFO:teuthology.orchestra.console.smithi167:Power off completed
2024-04-02T12:44:40.923 INFO:teuthology.orchestra.console.smithi167:Power on
2024-04-02T12:44:40.924 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-02T12:44:40.950 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On
2024-04-02T12:44:40.950 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T12:44:40.979 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2024-04-02T12:44:44.983 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T12:44:45.093 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2024-04-02T12:44:49.096 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-02T12:44:49.207 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2024-04-02T12:44:49.308 INFO:teuthology.orchestra.console.smithi167:Power on completed
2024-04-02T12:44:49.408 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2024-04-02T12:47:35.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:47:38.591 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-02T12:47:44.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:47:47.650 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-02T12:47:53.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:47:56.734 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-02T12:48:02.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:48:05.794 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-02T12:48:11.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:48:14.882 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-02T12:48:20.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:48:23.966 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-02T12:48:29.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:49:30.034 WARNING:teuthology.provision.fog.smithi167:timed out
2024-04-02T12:49:36.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:49:36.351 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-02T12:49:36.352 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-02T12:49:36.677 INFO:teuthology.provision.fog.smithi167:Node is ready
2024-04-02T12:49:36.677 DEBUG:teuthology.orchestra.run.smithi167:> hostname
2024-04-02T12:49:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2024-04-02T12:49:36.692 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts
2024-04-02T12:49:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2024-04-02T12:49:36.748 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2024-04-02T12:49:36.868 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts
2024-04-02T12:49:36.896 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts
2024-04-02T12:49:36.964 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname
2024-04-02T12:49:37.031 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2024-04-02T12:49:37.098 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2024-04-02T12:49:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T12:49:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T12:49:37.154 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2024-04-02T12:49:37.156 DEBUG:teuthology.parallel:result is None
2024-04-02T12:49:37.278 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2024-04-02T12:49:37.279 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-02T12:49:37.310 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2024-04-02T12:49:37.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2024-04-02T12:49:37.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-02T12:49:37.400 DEBUG:teuthology.orchestra.run.smithi167:> true
2024-04-02T12:49:37.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com'
2024-04-02T12:49:37.464 DEBUG:teuthology.orchestra.run.smithi167:> uname -m
2024-04-02T12:49:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2024-04-02T12:49:37.519 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2024-04-02T12:49:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2024-04-02T12:49:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9"
2024-04-02T12:49:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-02T12:49:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-02T12:49:37.575 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2024-04-02T12:49:37.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T12:49:37.685 INFO:teuthology.dispatcher.supervisor:Running job 7635566
2024-04-02T12:49:37.686 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-04-02_11:52:43-fs-wip-batrick-testing-20240402.004512-distro-default-smithi/7635566 --name pdonnell-2024-04-02_11:52:43-fs-wip-batrick-testing-20240402.004512-distro-default-smithi --description fs/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} -- /home/teuthworker/archive/pdonnell-2024-04-02_11:52:43-fs-wip-batrick-testing-20240402.004512-distro-default-smithi/7635566/orig.config.yaml
2024-04-02T12:49:37.689 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-04-02_11:52:43-fs-wip-batrick-testing-20240402.004512-distro-default-smithi/7635566
2024-04-02T12:49:37.689 INFO:teuthology.dispatcher.supervisor:Job PID: 254380
2024-04-02T12:49:37.689 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-02T12:51:37.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T12:53:37.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T12:55:38.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T12:57:38.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T12:59:38.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:01:38.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:03:38.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:05:38.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:07:39.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:09:39.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:11:39.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:13:39.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:15:39.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:17:39.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:19:40.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:21:40.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:23:40.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:25:40.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:27:40.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:29:40.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-02T13:29:41.077 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1