2024-02-21T12:23:50.926 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-21T12:23:50.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:23:51.032 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f223c633f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f223d694c10>, signals=[15])
2024-02-21T12:23:51.033 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2024-02-21T12:23:51.033 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T12:23:51.033 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2024-02-21T12:23:51.177 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-02-21T12:23:51.218 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 22.04
2024-02-21T12:23:51.577 INFO:teuthology.orchestra.console.smithi183:Power off
2024-02-21T12:23:51.577 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T12:23:51.600 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2024-02-21T12:23:51.600 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:51.621 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-02-21T12:23:51.722 INFO:teuthology.orchestra.console.smithi183:Power off completed
2024-02-21T12:23:51.822 INFO:teuthology.orchestra.console.smithi183:Power on
2024-02-21T12:23:51.823 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T12:23:51.847 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On
2024-02-21T12:23:51.848 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:51.867 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-02-21T12:23:55.872 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:55.981 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-02-21T12:23:59.984 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:24:00.130 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-02-21T12:24:00.231 INFO:teuthology.orchestra.console.smithi183:Power on completed
2024-02-21T12:24:00.332 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2024-02-21T12:27:18.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:27:37.148 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:27:43.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:27:46.204 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:27:52.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:27:55.260 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:28:01.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:28:04.348 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:28:10.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:28:28.860 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:28:34.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:28:37.948 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:28:43.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:28:44.956 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:28:50.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:28:50.962 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:28:56.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:28:56.971 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:29:02.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:02.979 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:29:08.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:08.988 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T12:29:14.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:15.227 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T12:29:15.228 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T12:29:15.686 INFO:teuthology.provision.fog.smithi183:Node is ready
2024-02-21T12:29:15.686 DEBUG:teuthology.orchestra.run.smithi183:> hostname
2024-02-21T12:29:15.730 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2024-02-21T12:29:15.731 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts
2024-02-21T12:29:15.779 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2024-02-21T12:29:15.780 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2024-02-21T12:29:15.890 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts
2024-02-21T12:29:15.904 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts
2024-02-21T12:29:15.963 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname
2024-02-21T12:29:16.023 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2024-02-21T12:29:16.078 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2024-02-21T12:29:16.131 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-21T12:29:16.131 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu"
2024-02-21T12:29:16.131 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="22.04"
2024-02-21T12:29:16.131 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-21T12:29:16.131 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=jammy
2024-02-21T12:29:16.131 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu
2024-02-21T12:29:16.132 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian
2024-02-21T12:29:16.132 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-21T12:29:16.132 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-21T12:29:16.132 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-21T12:29:16.132 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-21T12:29:16.132 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=jammy
2024-02-21T12:29:16.132 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2024-02-21T12:29:16.134 DEBUG:teuthology.parallel:result is None
2024-02-21T12:29:16.261 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2024-02-21T12:29:16.261 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T12:29:16.282 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2024-02-21T12:29:16.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2024-02-21T12:29:16.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:16.356 DEBUG:teuthology.orchestra.run.smithi183:> true
2024-02-21T12:29:16.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com'
2024-02-21T12:29:16.461 DEBUG:teuthology.orchestra.run.smithi183:> uname -m
2024-02-21T12:29:16.507 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2024-02-21T12:29:16.507 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2024-02-21T12:29:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-21T12:29:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu"
2024-02-21T12:29:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="22.04"
2024-02-21T12:29:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-21T12:29:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=jammy
2024-02-21T12:29:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu
2024-02-21T12:29:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian
2024-02-21T12:29:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-21T12:29:16.560 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-21T12:29:16.560 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-21T12:29:16.560 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-21T12:29:16.560 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=jammy
2024-02-21T12:29:16.560 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2024-02-21T12:29:16.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:29:16.660 INFO:teuthology.dispatcher.supervisor:Running job 7569540
2024-02-21T12:29:16.660 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_jcollin@teuthology --archive /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569540 --name jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi --description fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} -- /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569540/orig.config.yaml
2024-02-21T12:29:16.663 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569540
2024-02-21T12:29:16.664 INFO:teuthology.dispatcher.supervisor:Job PID: 941143
2024-02-21T12:29:16.664 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-21T12:31:16.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:33:16.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:35:17.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:37:17.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:39:17.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:41:17.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:43:17.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:45:17.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:47:18.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:49:18.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:51:18.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:53:18.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:55:18.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:57:18.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:59:19.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:01:19.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:03:19.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:05:19.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:07:19.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:09:19.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:11:20.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:13:20.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:15:20.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:17:20.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:19:20.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:21:20.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:23:21.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:25:21.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:27:21.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:29:21.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:31:21.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:33:21.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:35:22.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:37:22.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:39:22.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:41:22.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:43:22.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:45:22.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:47:22.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:49:23.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:51:23.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:53:23.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:55:23.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:57:23.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:59:23.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:01:24.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:03:24.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:05:24.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:07:24.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:09:24.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:11:24.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:13:25.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:15:25.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:17:25.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:19:25.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:19:25.726 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-02-21T14:19:25.800 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi183 but it was locked by another job: /home/teuthworker/archive/jcollin-2024-02-21_14:10:05-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569688