2022-02-28T16:02:23.869 INFO:root:teuthology version: 1.1.0-5825e8d0
2022-02-28T16:02:23.998 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi120.front.sepia.ceph.com' reimaging
2022-02-28T16:02:24.000 INFO:teuthology.lock.ops:Updating [ubuntu@smithi120.front.sepia.ceph.com]: reset os type and version on server
2022-02-28T16:02:24.000 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2022-02-28T16:02:24.020 INFO:teuthology.lock.ops:Node 'ubuntu@smithi120.front.sepia.ceph.com' reimaging is complete
2022-02-28T16:02:24.021 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging
2022-02-28T16:02:24.021 INFO:teuthology.lock.ops:Updating [ubuntu@smithi198.front.sepia.ceph.com]: reset os type and version on server
2022-02-28T16:02:24.022 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server
2022-02-28T16:02:24.041 INFO:teuthology.lock.ops:Node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging is complete
2022-02-28T16:02:24.240 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of ubuntu 20.04
2022-02-28T16:02:24.242 INFO:teuthology.provision.fog.smithi198:Scheduling deploy of ubuntu 20.04
2022-02-28T16:02:24.620 INFO:teuthology.orchestra.console:Power off smithi120
2022-02-28T16:02:24.632 INFO:teuthology.orchestra.console:Power off smithi198
2022-02-28T16:02:24.759 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2022-02-28T16:02:24.770 INFO:teuthology.orchestra.console:Power off for smithi198 completed
2022-02-28T16:02:24.860 INFO:teuthology.orchestra.console:Power on smithi120
2022-02-28T16:02:24.872 INFO:teuthology.orchestra.console:Power on smithi198
2022-02-28T16:02:29.119 INFO:teuthology.orchestra.console:Power on for smithi198 completed
2022-02-28T16:02:29.220 INFO:teuthology.provision.fog.smithi198:Waiting for deploy to finish
2022-02-28T16:02:33.222 INFO:teuthology.orchestra.console:Power on for smithi120 completed
2022-02-28T16:02:33.324 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2022-02-28T16:07:29.447 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-28T16:07:29.959 INFO:teuthology.provision.fog.smithi120:Node is ready
2022-02-28T16:07:29.966 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com
2022-02-28T16:07:30.014 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2022-02-28T16:07:30.131 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2022-02-28T16:07:30.618 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-28T16:07:31.169 INFO:teuthology.provision.fog.smithi198:Node is ready
2022-02-28T16:07:31.176 INFO:teuthology.orchestra.run.smithi198.stdout:smithi198.front.sepia.ceph.com
2022-02-28T16:07:31.184 INFO:teuthology.orchestra.run.smithi198.stdout:172.21.15.198 smithi198.front.sepia.ceph.com smithi198
2022-02-28T16:07:31.383 INFO:teuthology.provision.fog.smithi198:Deploy complete!
2022-02-28T16:07:31.550 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2022-02-28T16:07:31.551 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-28T16:07:31.570 INFO:teuthology.lock.ops:Checking smithi198.front.sepia.ceph.com
2022-02-28T16:07:31.570 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-28T16:07:31.588 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2022-02-28T16:07:31.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2022-02-28T16:07:31.779 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2022-02-28T16:07:31.786 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu"
2022-02-28T16:07:31.787 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-28T16:07:31.787 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu
2022-02-28T16:07:31.788 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian
2022-02-28T16:07:31.788 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-28T16:07:31.788 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="20.04"
2022-02-28T16:07:31.789 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-28T16:07:31.789 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-28T16:07:31.789 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-28T16:07:31.790 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-28T16:07:31.790 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=focal
2022-02-28T16:07:31.791 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=focal
2022-02-28T16:07:31.792 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2022-02-28T16:07:31.808 INFO:teuthology.lock.ops:Updating [smithi198.front.sepia.ceph.com]: set os type and version on server
2022-02-28T16:07:31.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com'
2022-02-28T16:07:31.982 INFO:teuthology.orchestra.run.smithi198.stdout:x86_64
2022-02-28T16:07:31.987 INFO:teuthology.orchestra.run.smithi198.stdout:NAME="Ubuntu"
2022-02-28T16:07:31.987 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-28T16:07:31.987 INFO:teuthology.orchestra.run.smithi198.stdout:ID=ubuntu
2022-02-28T16:07:31.987 INFO:teuthology.orchestra.run.smithi198.stdout:ID_LIKE=debian
2022-02-28T16:07:31.988 INFO:teuthology.orchestra.run.smithi198.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-28T16:07:31.988 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_ID="20.04"
2022-02-28T16:07:31.988 INFO:teuthology.orchestra.run.smithi198.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-28T16:07:31.988 INFO:teuthology.orchestra.run.smithi198.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-28T16:07:31.989 INFO:teuthology.orchestra.run.smithi198.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-28T16:07:31.989 INFO:teuthology.orchestra.run.smithi198.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-28T16:07:31.989 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_CODENAME=focal
2022-02-28T16:07:31.989 INFO:teuthology.orchestra.run.smithi198.stdout:UBUNTU_CODENAME=focal
2022-02-28T16:07:31.990 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server
2022-02-28T16:07:32.077 INFO:teuthology.dispatcher.supervisor:Running job 6710997
2022-02-28T16:07:32.077 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5825e8d094b6aff4351d26f1ceb5efc598c156a0/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-02-28_15:25:26-rados-balancer-perf-distro-default-smithi/6710997 --name lflores-2022-02-28_15:25:26-rados-balancer-perf-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/lflores-2022-02-28_15:25:26-rados-balancer-perf-distro-default-smithi/6710997/orig.config.yaml
2022-02-28T16:07:32.086 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-02-28_15:25:26-rados-balancer-perf-distro-default-smithi/6710997
2022-02-28T16:07:32.087 INFO:teuthology.dispatcher.supervisor:Job PID: 29385
2022-02-28T16:07:32.087 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-28T22:38:00.898 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-28T22:38:01.178 INFO:teuthology.kill:Killing Pids: {29385}
2022-02-28T22:38:02.496 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['host.a', 'client.0']
2022-02-28T22:38:02.497 INFO:teuthology.task.internal:roles: ubuntu@smithi198.front.sepia.ceph.com - ['host.b', 'client.1']
2022-02-28T22:38:02.498 INFO:teuthology.misc:Compressing logs...
2022-02-28T22:38:02.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2022-02-28T22:38:02.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com'
2022-02-28T22:38:02.692 INFO:teuthology.orchestra.run.smithi120.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-02-28T22:38:02.859 INFO:teuthology.orchestra.run.smithi198.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-02-28T22:38:02.897 INFO:teuthology.orchestra.run.smithi120.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-28T22:38:02.897 INFO:teuthology.orchestra.run.smithi120.stderr:tar: Error is not recoverable: exiting now
2022-02-28T22:38:02.918 INFO:teuthology.orchestra.run.smithi198.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-28T22:38:02.918 INFO:teuthology.orchestra.run.smithi198.stderr:tar: Error is not recoverable: exiting now
2022-02-28T22:38:02.919 INFO:teuthology.misc:Compressing logs...
2022-02-28T22:38:03.118 INFO:teuthology.misc:Compressing logs...
2022-02-28T22:38:17.051 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-02-28T22:38:20.024 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-mon.smithi198.log: file size changed while zipping
2022-02-28T22:38:23.854 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-02-28T22:38:32.757 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-mon.smithi120.log: file size changed while zipping
2022-02-28T22:38:37.746 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-02-28T22:38:48.712 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-02-28T22:38:50.776 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-mgr.smithi120.qroupl.log: file size changed while zipping
2022-02-28T22:38:53.816 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-02-28T22:39:04.772 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-02-28T22:39:08.597 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-02-28T22:39:25.592 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/6f47c910-98b1-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-02-28T22:40:02.101 INFO:teuthology.kill:No teuthology processes running
2022-02-28T22:40:03.253 INFO:teuthology.kill:Nuking machines: ['smithi120', 'smithi198']
2022-02-28T22:40:04.220 INFO:teuthology.kill:2022-02-28 22:40:04,219.219 INFO:teuthology.nuke:targets:
2022-02-28T22:40:04.221 INFO:teuthology.kill:  smithi120.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiD08HZQLb3HdbCwDHyFPSgAClL9+KmHbvpAdUFwBPJwKtxVgcBaFyITxEiaClCLHz70P3DwH8Q7DMrh+mwTLWQ0lkAvDlMl8hJBe2MjNnNjiQRhAnpECBJpoDgpTMi+xde8emgQhigvzTXjSf+v5GwCDpktcuxK9zUwkRCwvgiHPb1c46u/iiXvxYJI4JIq1ylvyD5QmgZ7+AiNuF2ZPwTog8aSitTL0O5dd7kUOsbsF1JM6s0udSKj/PqkTvy97oMotrm9r7kCxM15TiVlXGLJ32hw8dm4ssiyOg3ilvR51OnirBNllwYGH5NesQsH9WCosHu3EcOycWi0bI/sJoXI3idJQrY6BXdrtHVzYK/S+Ff9Owms0MJ90wkp1/e/UrJrs3E/YXzTy67nyv31pf8VwHNTbSa+VmHzZWvVEViI/lApiPyJR4lLyUHduAihQ35yBLd+vmKQ5i7S4hghgk1KxSMlrh50jCYdsNG28/gCtq7xtyqjnlwvL9eGngfo0=
2022-02-28T22:40:04.221 INFO:teuthology.kill:  smithi198.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCih8oFvRlRRfr5035Bs2yetMGvBiU+mw3B5o85dcVz1v9JWCOUzPJa+DAWWUCTlbnDTuLa71XMr3cCQPzeCUnBPoboQ9ZFhXzILd6mlt3FtlEA4pQirkcJ338uwCrhlt3eWW8PS+4slTRrkkVmE0lAu6INcV0oamHKghu/Gq4j/VUbNoCw2ZwdRfXw05FfL2K1O3b1zFCZASchCch/ObtSAK4N9N3ioeEXkeGzyIKd5w6XmkLRbthYxwxroIE3TPjyc8bSJeQTN7ZC5biIReNneSLYStMf5FzDgRoA+eSMJv8G4aLg8On8MX3EQ6c9aaNlDeBZDOOfj5BB9bpi3EBaGLXeolGN4AQ4i1bAcyJALAZievDdZo2b/VphSlXqY8WSwNShWAzUH8m5pdP+c6Ct3aTItv38fSCMHd1QRsqk82QR28XWU+B9L42c/U3DGXxMINhC+2J7YbogPVQJQI8i1VNcFmBTcntfhEpGClvq5th24m3c//YrCS8v4uBK178=
2022-02-28T22:40:04.253 INFO:teuthology.kill:2022-02-28 22:40:04,252.252 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-28T22:40:04.258 INFO:teuthology.kill:2022-02-28 22:40:04,258.258 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-28T22:40:04.341 INFO:teuthology.kill:2022-02-28 22:40:04,341.341 INFO:teuthology.orchestra.console:Power off smithi198
2022-02-28T22:40:04.355 INFO:teuthology.kill:2022-02-28 22:40:04,355.355 INFO:teuthology.orchestra.console:Power off smithi120
2022-02-28T22:40:12.715 INFO:teuthology.kill:2022-02-28 22:40:12,714.714 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2022-02-28T22:40:12.861 INFO:teuthology.kill:2022-02-28 22:40:12,860.860 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com
2022-02-28T22:40:16.820 INFO:teuthology.kill:2022-02-28 22:40:16,820.820 INFO:teuthology.orchestra.console:Power off for smithi198 completed
2022-02-28T22:40:16.967 INFO:teuthology.kill:2022-02-28 22:40:16,967.967 INFO:teuthology.lock.ops:unlocked: smithi198.front.sepia.ceph.com
2022-02-28T22:42:17.267 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-28T22:42:17.357 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi120 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-28_21:23:00-rados-wip-yuri-testing-2022-02-28-0823-quincy-distro-default-smithi/6712115
2022-02-28T22:42:17.358 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi198 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-28_21:23:00-rados-wip-yuri-testing-2022-02-28-0823-quincy-distro-default-smithi/6712115