2022-01-12T23:29:07.865 INFO:root:teuthology version: 1.1.0-6fc20113
2022-01-12T23:29:07.997 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging
2022-01-12T23:29:07.998 INFO:teuthology.lock.ops:Updating [ubuntu@smithi023.front.sepia.ceph.com]: reset os type and version on server
2022-01-12T23:29:07.999 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2022-01-12T23:29:08.018 INFO:teuthology.lock.ops:Node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging is complete
2022-01-12T23:29:08.019 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi139.front.sepia.ceph.com' reimaging
2022-01-12T23:29:08.019 INFO:teuthology.lock.ops:Updating [ubuntu@smithi139.front.sepia.ceph.com]: reset os type and version on server
2022-01-12T23:29:08.020 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2022-01-12T23:29:08.038 INFO:teuthology.lock.ops:Node 'ubuntu@smithi139.front.sepia.ceph.com' reimaging is complete
2022-01-12T23:29:08.230 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of ubuntu 20.04
2022-01-12T23:29:08.252 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of ubuntu 20.04
2022-01-12T23:29:08.627 INFO:teuthology.orchestra.console:Power off smithi023
2022-01-12T23:29:08.642 INFO:teuthology.orchestra.console:Power off smithi139
2022-01-12T23:29:17.012 INFO:teuthology.orchestra.console:Power off for smithi139 completed
2022-01-12T23:29:17.114 INFO:teuthology.orchestra.console:Power on smithi139
2022-01-12T23:29:21.120 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2022-01-12T23:29:21.223 INFO:teuthology.orchestra.console:Power on smithi023
2022-01-12T23:29:25.487 INFO:teuthology.orchestra.console:Power on for smithi139 completed
2022-01-12T23:29:25.588 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish
2022-01-12T23:29:29.592 INFO:teuthology.orchestra.console:Power on for smithi023 completed
2022-01-12T23:29:29.694 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2022-01-12T23:32:46.095 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed.
2022-01-12T23:34:45.158 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-12T23:34:45.743 INFO:teuthology.provision.fog.smithi139:Node is ready
2022-01-12T23:34:45.750 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com
2022-01-12T23:34:45.799 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139
2022-01-12T23:34:45.995 INFO:teuthology.provision.fog.smithi139:Deploy complete!
2022-01-12T23:36:05.270 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-12T23:36:05.789 INFO:teuthology.provision.fog.smithi023:Node is ready
2022-01-12T23:36:05.795 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2022-01-12T23:36:05.801 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2022-01-12T23:36:05.947 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2022-01-12T23:36:06.157 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2022-01-12T23:36:06.158 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-12T23:36:06.177 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com
2022-01-12T23:36:06.178 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-12T23:36:06.195 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2022-01-12T23:36:06.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2022-01-12T23:36:06.377 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2022-01-12T23:36:06.383 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Ubuntu"
2022-01-12T23:36:06.383 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-12T23:36:06.384 INFO:teuthology.orchestra.run.smithi023.stdout:ID=ubuntu
2022-01-12T23:36:06.384 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE=debian
2022-01-12T23:36:06.384 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-12T23:36:06.384 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="20.04"
2022-01-12T23:36:06.385 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-12T23:36:06.385 INFO:teuthology.orchestra.run.smithi023.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-12T23:36:06.385 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-12T23:36:06.385 INFO:teuthology.orchestra.run.smithi023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-12T23:36:06.386 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_CODENAME=focal
2022-01-12T23:36:06.386 INFO:teuthology.orchestra.run.smithi023.stdout:UBUNTU_CODENAME=focal
2022-01-12T23:36:06.387 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2022-01-12T23:36:06.405 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server
2022-01-12T23:36:06.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2022-01-12T23:36:06.666 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64
2022-01-12T23:36:06.715 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu"
2022-01-12T23:36:06.716 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-12T23:36:06.716 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu
2022-01-12T23:36:06.716 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian
2022-01-12T23:36:06.717 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-12T23:36:06.717 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04"
2022-01-12T23:36:06.717 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-12T23:36:06.718 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-12T23:36:06.718 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-12T23:36:06.718 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-12T23:36:06.719 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal
2022-01-12T23:36:06.719 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal
2022-01-12T23:36:06.719 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2022-01-12T23:36:06.816 INFO:teuthology.dispatcher.supervisor:Running job 6611579
2022-01-12T23:36:06.817 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-12_21:37:22-rados-wip-yuri6-testing-2022-01-12-1131-distro-default-smithi/6611579 --name yuriw-2022-01-12_21:37:22-rados-wip-yuri6-testing-2022-01-12-1131-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-12_21:37:22-rados-wip-yuri6-testing-2022-01-12-1131-distro-default-smithi/6611579/orig.config.yaml
2022-01-12T23:36:06.820 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-12_21:37:22-rados-wip-yuri6-testing-2022-01-12-1131-distro-default-smithi/6611579
2022-01-12T23:36:06.821 INFO:teuthology.dispatcher.supervisor:Job PID: 10143
2022-01-12T23:36:06.821 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-13T11:36:27.223 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-13T11:36:27.379 INFO:teuthology.kill:Killing Pids: {10143}
2022-01-13T11:36:28.586 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-13T11:36:28.587 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-13T11:36:28.587 INFO:teuthology.misc:Compressing logs...
2022-01-13T11:36:28.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2022-01-13T11:36:28.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2022-01-13T11:36:28.778 INFO:teuthology.orchestra.run.smithi023.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-01-13T11:36:28.949 INFO:teuthology.orchestra.run.smithi139.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-01-13T11:36:28.970 INFO:teuthology.orchestra.run.smithi023.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-13T11:36:28.971 INFO:teuthology.orchestra.run.smithi023.stderr:tar: Error is not recoverable: exiting now
2022-01-13T11:36:29.009 INFO:teuthology.orchestra.run.smithi139.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-13T11:36:29.010 INFO:teuthology.orchestra.run.smithi139.stderr:tar: Error is not recoverable: exiting now
2022-01-13T11:36:29.012 INFO:teuthology.misc:Compressing logs...
2022-01-13T11:36:29.339 INFO:teuthology.misc:Compressing logs...
2022-01-13T11:36:32.690 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-mgr.smithi023.zkajch.log: file size changed while zipping
2022-01-13T11:36:46.615 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-13T11:36:46.625 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-13T11:36:59.086 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-13T11:37:02.106 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-13T11:37:16.319 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-13T11:37:19.637 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-mon.smithi023.log: file size changed while zipping
2022-01-13T11:37:22.396 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-mon.smithi139.log: file size changed while zipping
2022-01-13T11:37:35.603 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-13T11:37:38.286 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-13T11:37:52.310 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/6923a39e-7401-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-13T11:38:30.212 INFO:teuthology.kill:No teuthology processes running
2022-01-13T11:38:31.392 INFO:teuthology.kill:Nuking machines: ['smithi023', 'smithi139']
2022-01-13T11:38:32.360 INFO:teuthology.kill:2022-01-13 11:38:32,360.360 INFO:teuthology.nuke:targets:
2022-01-13T11:38:32.361 INFO:teuthology.kill:  smithi023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQSAjyxYaxnJ12coYpUvjGG0E/TnW1rmiZycRIT3nxYovwLTxspj+yoznJKfdz8heWsqwczxa47mbs73X6gASjB3vqkXu71EgE/3EPm5aerZrhsSLWn7Yvb/a/w0G7EJaAHk92L9O3DtAY2NQcOrLeXy+goRUCyv16tCLINtL22tyOQpR/xsfWGemEc/jRBAAitbhV0y6oKar9QLnUrDWx13q1vGWxiYfFLM8fTl9sAXh+sn41ifQNo+lg/Ls7/ur6S73DuzUlisxoaS5ttOwleJg5J8aT4j2nIW2wcD//WMp4vwzRqiQuMYNqqV21VDgp9XyF71fcGRP82eyeIoyZbP31QOd4CQE2JWO0+3sN5EOpdtJi5OQYpKRz07YkBmNBaUqXGGaz0qZuzQH9ShV3GVrHXKQtA+vGEVwXBfrsV8XY75+gTf/mQXXhnM/fbQRCdPGzUCJaOaqFvqsBWUSyNIu2E4R+9+GL7E4gxjvVEhIs+00rs5jbPKaUIJKasWM=
2022-01-13T11:38:32.361 INFO:teuthology.kill:  smithi139.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDlYoXeXsU4Yzavmz8xSsu9iHiaCB+pYe07tFVsiVWRX4f7wc5CzTYflPskFYJUReRhkc/zIkI/eK/7pg/OxBECJpqHoOpW/Y67YamCVjF6LYaMJziNc+R5he1unigoqmBKp3EtvQT9RxRZ/oAQXn4w7odDafZW0GkT6D5eU6Qzx5I2diY8MKwtkRTnFTlgI53QPEq8Zi4N5h0VpKNKBp483kC+DeTMP5kef8j6cSokt9Ibq4BxfOkdjhfwMXmD5ei8LvWVwEunNlA+cAAWSPKoBTaqpVQLghgKYC2mgPUywGbTRBXecVGguJfKe50JVA/T1z9/DNr6I2Et7A2mh7t8naEUWfh6owm0qOxpgzVbKaCc+5An0o7D2VLa9g/UbuWpUf6v+SBD21sTMUiaBCHN0fabQiUZ2pPqttV9vhpqyjo07lNxd5TMjE1gr/eI0DwpctCFNTtloJhoDGHNhYo+LKhHKN/E3oS1K2Q87hPtir7XNbpMRN2NzNi+vdGnqyc=
2022-01-13T11:38:32.398 INFO:teuthology.kill:2022-01-13 11:38:32,398.398 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-13T11:38:32.402 INFO:teuthology.kill:2022-01-13 11:38:32,401.401 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-13T11:38:32.478 INFO:teuthology.kill:2022-01-13 11:38:32,478.478 INFO:teuthology.orchestra.console:Power off smithi139
2022-01-13T11:38:32.493 INFO:teuthology.kill:2022-01-13 11:38:32,492.492 INFO:teuthology.orchestra.console:Power off smithi023
2022-01-13T11:38:40.852 INFO:teuthology.kill:2022-01-13 11:38:40,851.851 INFO:teuthology.orchestra.console:Power off for smithi139 completed
2022-01-13T11:38:40.856 INFO:teuthology.kill:2022-01-13 11:38:40,856.856 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2022-01-13T11:38:41.006 INFO:teuthology.kill:2022-01-13 11:38:41,005.005 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com
2022-01-13T11:38:41.007 INFO:teuthology.kill:2022-01-13 11:38:41,007.007 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com
2022-01-13T11:40:41.232 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-13T11:40:41.323 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi023 but it was locked by another job: /home/teuthworker/archive/benhanokh-2022-01-13_05:29:27-rados-WIP_GBH_safe_fast_shutdown_A4-distro-basic-smithi/6612212
2022-01-13T11:40:41.324 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi139 but it was locked by another job: /home/teuthworker/archive/benhanokh-2022-01-13_05:29:27-rados-WIP_GBH_safe_fast_shutdown_A4-distro-basic-smithi/6612212