2024-02-21T12:23:50.365 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-21T12:23:50.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:23:50.481 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1fe2fc5f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1fe4026c10>, signals=[15])
2024-02-21T12:23:50.482 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging
2024-02-21T12:23:50.482 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T12:23:50.482 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2024-02-21T12:23:50.620 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-02-21T12:23:50.667 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of ubuntu 22.04
2024-02-21T12:23:51.007 INFO:teuthology.orchestra.console.smithi077:Power off
2024-02-21T12:23:51.007 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T12:23:51.027 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off
2024-02-21T12:23:51.028 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:51.051 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-02-21T12:23:51.152 INFO:teuthology.orchestra.console.smithi077:Power off completed
2024-02-21T12:23:51.252 INFO:teuthology.orchestra.console.smithi077:Power on
2024-02-21T12:23:51.252 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T12:23:51.274 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On
2024-02-21T12:23:51.274 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:51.296 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-02-21T12:23:55.300 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:55.409 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-02-21T12:23:59.412 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T12:23:59.521 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on
2024-02-21T12:23:59.621 INFO:teuthology.orchestra.console.smithi077:Power on completed
2024-02-21T12:23:59.722 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2024-02-21T12:27:18.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:27:18.609 ERROR:teuthology.orchestra.connection:Error authenticating with smithi077.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-21T12:28:22.612 WARNING:teuthology.provision.fog.smithi077:timed out
2024-02-21T12:28:28.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:28:47.036 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-02-21T12:28:53.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:28:56.092 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-02-21T12:29:02.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:02.095 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-02-21T12:29:08.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:08.098 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-02-21T12:29:14.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:14.102 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-02-21T12:29:20.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:20.105 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-02-21T12:29:26.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:26.345 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T12:29:26.345 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T12:29:26.772 INFO:teuthology.provision.fog.smithi077:Node is ready
2024-02-21T12:29:26.772 DEBUG:teuthology.orchestra.run.smithi077:> hostname
2024-02-21T12:29:26.818 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2024-02-21T12:29:26.819 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts
2024-02-21T12:29:26.867 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2024-02-21T12:29:26.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2024-02-21T12:29:27.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts
2024-02-21T12:29:27.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts
2024-02-21T12:29:27.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname
2024-02-21T12:29:27.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2024-02-21T12:29:27.197 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2024-02-21T12:29:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-21T12:29:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu"
2024-02-21T12:29:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="22.04"
2024-02-21T12:29:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-21T12:29:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=jammy
2024-02-21T12:29:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu
2024-02-21T12:29:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian
2024-02-21T12:29:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-21T12:29:27.252 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-21T12:29:27.252 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-21T12:29:27.252 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-21T12:29:27.252 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=jammy
2024-02-21T12:29:27.253 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2024-02-21T12:29:27.254 DEBUG:teuthology.parallel:result is None
2024-02-21T12:29:27.385 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2024-02-21T12:29:27.385 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T12:29:27.406 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2024-02-21T12:29:27.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2024-02-21T12:29:27.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T12:29:27.487 DEBUG:teuthology.orchestra.run.smithi077:> true
2024-02-21T12:29:27.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com'
2024-02-21T12:29:27.576 DEBUG:teuthology.orchestra.run.smithi077:> uname -m
2024-02-21T12:29:27.621 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2024-02-21T12:29:27.622 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2024-02-21T12:29:27.673 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu"
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="22.04"
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=jammy
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-21T12:29:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=jammy
2024-02-21T12:29:27.675 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2024-02-21T12:29:27.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:29:27.776 INFO:teuthology.dispatcher.supervisor:Running job 7569538
2024-02-21T12:29:27.776 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_jcollin@teuthology --archive /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569538 --name jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi --description fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} -- /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569538/orig.config.yaml
2024-02-21T12:29:27.779 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569538
2024-02-21T12:29:27.779 INFO:teuthology.dispatcher.supervisor:Job PID: 941382
2024-02-21T12:29:27.779 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-21T12:31:27.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:33:27.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:35:27.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:37:28.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:39:28.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:41:28.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:43:28.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:45:28.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:47:28.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:49:28.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:51:28.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:53:28.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:55:28.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:57:28.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T12:59:28.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:01:28.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:03:29.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:05:29.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:07:29.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:09:29.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:11:29.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:13:29.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:15:29.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:17:29.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:19:29.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:21:29.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:23:29.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:25:29.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:27:29.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:29:29.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:31:30.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:33:30.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:35:30.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:37:30.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:39:30.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:41:30.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:43:30.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:45:30.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:47:30.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:49:30.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:51:30.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:53:30.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:55:30.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:57:30.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T13:59:30.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:01:31.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:03:31.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:05:31.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:07:31.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:09:31.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:11:31.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:13:31.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:15:31.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:17:31.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:19:31.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T14:19:31.727 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-02-21T14:19:31.817 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi077 but it was locked by another job: /home/teuthworker/archive/jcollin-2024-02-21_14:10:05-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569682