2024-02-21T12:23:44.646 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-21T12:23:44.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:23:44.751 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f985c174c10>, signals=[15]) 2024-02-21T12:23:44.752 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2024-02-21T12:23:44.752 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2024-02-21T12:23:44.752 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-02-21T12:23:44.890 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-21T12:23:44.938 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of ubuntu 22.04 2024-02-21T12:23:45.215 INFO:teuthology.orchestra.console.smithi071:Power off 2024-02-21T12:23:45.215 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T12:23:45.236 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-02-21T12:23:45.237 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T12:23:45.263 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-21T12:23:49.268 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T12:23:49.377 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-21T12:23:53.382 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T12:23:53.491 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-21T12:23:57.496 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T12:23:57.604 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-02-21T12:23:57.705 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-02-21T12:23:57.806 INFO:teuthology.orchestra.console.smithi071:Power on 2024-02-21T12:23:57.806 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-21T12:23:57.827 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2024-02-21T12:23:57.827 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T12:23:57.846 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-02-21T12:24:01.848 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T12:24:01.957 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-02-21T12:24:02.058 INFO:teuthology.orchestra.console.smithi071:Power on completed 2024-02-21T12:24:02.158 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2024-02-21T12:27:35.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:27:54.300 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-21T12:28:00.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:28:03.392 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-21T12:28:09.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:28:12.476 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-21T12:28:18.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:28:21.536 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-21T12:28:27.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:28:59.069 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-21T12:29:05.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:29:05.074 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-21T12:29:11.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:29:11.083 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-21T12:29:17.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:29:17.085 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-02-21T12:29:23.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:29:23.391 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-21T12:29:23.391 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-21T12:29:24.024 INFO:teuthology.provision.fog.smithi071:Node is ready 2024-02-21T12:29:24.024 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2024-02-21T12:29:24.029 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2024-02-21T12:29:24.029 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2024-02-21T12:29:24.075 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2024-02-21T12:29:24.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-02-21T12:29:24.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2024-02-21T12:29:24.211 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2024-02-21T12:29:24.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2024-02-21T12:29:24.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-02-21T12:29:24.373 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-02-21T12:29:24.418 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-21T12:29:24.418 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Ubuntu" 2024-02-21T12:29:24.418 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="22.04" 2024-02-21T12:29:24.418 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-21T12:29:24.418 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_CODENAME=jammy 2024-02-21T12:29:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:ID=ubuntu 2024-02-21T12:29:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE=debian 2024-02-21T12:29:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-21T12:29:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-21T12:29:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-21T12:29:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-21T12:29:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:UBUNTU_CODENAME=jammy 2024-02-21T12:29:24.420 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2024-02-21T12:29:24.421 DEBUG:teuthology.parallel:result is None 2024-02-21T12:29:24.543 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2024-02-21T12:29:24.544 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-21T12:29:24.564 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2024-02-21T12:29:24.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-21T12:29:24.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T12:29:24.640 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-02-21T12:29:24.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-02-21T12:29:24.744 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-02-21T12:29:24.790 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-02-21T12:29:24.791 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-02-21T12:29:24.838 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Ubuntu" 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="22.04" 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_CODENAME=jammy 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:ID=ubuntu 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE=debian 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-21T12:29:24.839 INFO:teuthology.orchestra.run.smithi071.stdout:UBUNTU_CODENAME=jammy 2024-02-21T12:29:24.840 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-02-21T12:29:24.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:29:24.980 INFO:teuthology.dispatcher.supervisor:Running job 7569521 2024-02-21T12:29:24.980 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_jcollin@teuthology --archive /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569521 --name jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi --description fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} -- /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569521/orig.config.yaml 2024-02-21T12:29:24.983 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jcollin-2024-02-21_12:22:34-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569521 2024-02-21T12:29:24.984 INFO:teuthology.dispatcher.supervisor:Job PID: 941307 2024-02-21T12:29:24.984 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-21T12:31:25.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:33:25.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:35:25.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:37:25.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:39:25.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:41:25.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:43:26.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:45:26.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:47:26.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:49:26.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:51:26.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:53:26.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:55:27.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:57:27.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T12:59:27.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:01:27.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:03:27.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:05:27.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:07:28.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:09:28.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:11:28.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:13:28.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:15:28.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:17:28.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:19:29.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:21:29.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:23:29.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:25:29.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:27:29.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:29:29.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:31:30.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:33:30.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:35:30.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:37:30.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:39:30.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:41:30.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:43:31.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:45:31.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:47:31.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:49:31.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:51:31.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:53:31.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:55:31.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:57:32.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T13:59:32.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:01:32.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:03:32.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:05:32.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:07:32.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:09:32.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:11:33.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:13:33.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:15:33.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:17:33.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:19:33.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T14:19:33.775 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-21T14:19:33.857 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi071 but it was locked by another job: /home/teuthworker/archive/jcollin-2024-02-21_14:10:05-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7569659