2024-02-21T12:23:46.694 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-21T12:23:46.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:23:46.795 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1e59818f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1e5a879c10>, signals=[15])
2024-02-21T12:23:46.795 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-02-21T12:23:46.795 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T12:23:46.795 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-21T12:23:46.921 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-02-21T12:23:46.959 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 22.04
2024-02-21T12:23:47.245 INFO:teuthology.orchestra.console.smithi163:Power off
2024-02-21T12:23:47.245 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T12:23:47.270 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-02-21T12:23:47.270 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:47.292 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-21T12:23:51.296 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:51.406 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-21T12:23:55.408 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:55.517 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-21T12:23:55.617 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-02-21T12:23:55.718 INFO:teuthology.orchestra.console.smithi163:Power on
2024-02-21T12:23:55.718 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T12:23:55.739 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-02-21T12:23:55.740 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:55.758 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-21T12:23:59.760 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:59.870 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-21T12:24:03.874 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:24:03.984 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-21T12:24:04.085 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-02-21T12:24:04.186 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-02-21T12:31:26.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:31:29.116 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:31:35.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:31:38.172 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:31:44.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:31:47.260 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:31:53.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:31:56.316 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:32:02.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:32:05.404 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:32:11.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:32:14.460 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:32:20.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:32:23.552 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:32:29.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:32:32.636 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:32:38.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:32:41.696 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-21T12:32:47.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:33:47.765 WARNING:teuthology.provision.fog.smithi163:timed out
2024-02-21T12:33:53.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:33:54.042 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T12:33:54.043 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T12:33:54.525 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-02-21T12:33:54.525 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-02-21T12:33:54.571 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2024-02-21T12:33:54.572 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2024-02-21T12:33:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-02-21T12:33:54.621 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-21T12:33:54.787 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2024-02-21T12:33:54.800 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-02-21T12:33:54.859 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2024-02-21T12:33:54.919 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-21T12:33:54.975 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-21T12:33:55.025 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-21T12:33:55.025 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu"
2024-02-21T12:33:55.025 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04"
2024-02-21T12:33:55.025 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-21T12:33:55.026 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy
2024-02-21T12:33:55.026 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu
2024-02-21T12:33:55.026 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian
2024-02-21T12:33:55.026 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-21T12:33:55.026 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-21T12:33:55.026 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-21T12:33:55.026 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-21T12:33:55.026 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy
2024-02-21T12:33:55.027 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-02-21T12:33:55.032 DEBUG:teuthology.parallel:result is None
2024-02-21T12:33:55.163 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2024-02-21T12:33:55.164 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T12:33:55.185 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2024-02-21T12:33:55.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-21T12:33:55.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:33:55.284 DEBUG:teuthology.orchestra.run.smithi163:> true
2024-02-21T12:33:55.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-21T12:33:55.385 DEBUG:teuthology.orchestra.run.smithi163:> uname -m
2024-02-21T12:33:55.432 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2024-02-21T12:33:55.432 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-21T12:33:55.483 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu"
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04"
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-21T12:33:55.484 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-21T12:33:55.485 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-21T12:33:55.485 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy
2024-02-21T12:33:55.485 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-21T12:33:55.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:33:55.584 INFO:teuthology.dispatcher.supervisor:Running job 7569527
2024-02-21T12:33:55.584 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_jcollin@teuthology --archive /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569527 --name jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi --description fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} -- /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569527/orig.config.yaml
2024-02-21T12:33:55.589 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569527
2024-02-21T12:33:55.589 INFO:teuthology.dispatcher.supervisor:Job PID: 956118
2024-02-21T12:33:55.589 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-21T12:35:55.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:37:55.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:39:56.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:41:56.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:43:56.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:45:56.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:47:56.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:49:56.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:51:57.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:53:57.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:55:57.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:57:57.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:59:57.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:01:57.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:03:58.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:05:58.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:07:58.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:09:58.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:11:58.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:13:58.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:15:59.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:17:59.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:19:59.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:21:59.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:23:59.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:25:59.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:28:00.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:30:00.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:32:00.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:34:00.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:36:00.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:38:00.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:40:01.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:42:01.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:44:01.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:46:01.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:48:01.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:50:01.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:52:02.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:54:02.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:56:02.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:58:02.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:00:02.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:02:02.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:04:03.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:06:03.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:08:03.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:10:03.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:12:03.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:14:03.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:16:04.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:18:04.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:20:04.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:20:04.441 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-02-21T14:20:04.526 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/jcollin-2024-02-21_14:10:05-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569672