2022-01-19T07:14:43.218 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-19T07:14:43.345 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi001.front.sepia.ceph.com' reimaging 2022-01-19T07:14:43.346 INFO:teuthology.lock.ops:Updating [ubuntu@smithi001.front.sepia.ceph.com]: reset os type and version on server 2022-01-19T07:14:43.347 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2022-01-19T07:14:43.365 INFO:teuthology.lock.ops:Node 'ubuntu@smithi001.front.sepia.ceph.com' reimaging is complete 2022-01-19T07:14:43.365 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging 2022-01-19T07:14:43.365 INFO:teuthology.lock.ops:Updating [ubuntu@smithi006.front.sepia.ceph.com]: reset os type and version on server 2022-01-19T07:14:43.366 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2022-01-19T07:14:43.385 INFO:teuthology.lock.ops:Node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging is complete 2022-01-19T07:14:43.613 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of ubuntu 18.04 2022-01-19T07:14:43.625 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of ubuntu 18.04 2022-01-19T07:14:43.997 INFO:teuthology.orchestra.console:Power off smithi006 2022-01-19T07:14:44.048 INFO:teuthology.orchestra.console:Power off smithi001 2022-01-19T07:14:52.382 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2022-01-19T07:14:52.414 INFO:teuthology.orchestra.console:Power off for smithi001 completed 2022-01-19T07:14:52.483 INFO:teuthology.orchestra.console:Power on smithi006 2022-01-19T07:14:52.516 INFO:teuthology.orchestra.console:Power on smithi001 2022-01-19T07:15:00.852 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2022-01-19T07:15:00.874 INFO:teuthology.orchestra.console:Power on for smithi001 completed 2022-01-19T07:15:00.954 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2022-01-19T07:15:00.975 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish 2022-01-19T07:19:29.472 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-19T07:19:29.752 INFO:teuthology.provision.fog.smithi001:Node is ready 2022-01-19T07:19:29.802 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com 2022-01-19T07:19:29.850 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001 2022-01-19T07:19:30.141 INFO:teuthology.provision.fog.smithi001:Deploy complete! 2022-01-19T07:19:38.484 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-19T07:19:38.727 INFO:teuthology.provision.fog.smithi006:Node is ready 2022-01-19T07:19:38.775 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2022-01-19T07:19:38.824 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2022-01-19T07:19:39.132 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2022-01-19T07:19:39.290 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com 2022-01-19T07:19:39.291 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-19T07:19:39.310 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2022-01-19T07:19:39.310 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-19T07:19:39.331 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server 2022-01-19T07:19:39.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2022-01-19T07:19:39.634 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2022-01-19T07:19:39.682 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Ubuntu" 2022-01-19T07:19:39.682 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-01-19T07:19:39.682 INFO:teuthology.orchestra.run.smithi001.stdout:ID=ubuntu 2022-01-19T07:19:39.683 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE=debian 2022-01-19T07:19:39.683 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-01-19T07:19:39.683 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="18.04" 2022-01-19T07:19:39.683 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-19T07:19:39.684 INFO:teuthology.orchestra.run.smithi001.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-19T07:19:39.684 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-19T07:19:39.684 INFO:teuthology.orchestra.run.smithi001.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-19T07:19:39.684 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_CODENAME=bionic 2022-01-19T07:19:39.685 INFO:teuthology.orchestra.run.smithi001.stdout:UBUNTU_CODENAME=bionic 2022-01-19T07:19:39.686 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2022-01-19T07:19:39.704 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2022-01-19T07:19:39.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2022-01-19T07:19:40.004 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2022-01-19T07:19:40.052 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2022-01-19T07:19:40.052 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-01-19T07:19:40.052 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2022-01-19T07:19:40.053 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2022-01-19T07:19:40.053 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-01-19T07:19:40.053 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="18.04" 2022-01-19T07:19:40.053 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-19T07:19:40.054 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-19T07:19:40.054 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-19T07:19:40.054 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-19T07:19:40.054 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=bionic 2022-01-19T07:19:40.055 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=bionic 2022-01-19T07:19:40.055 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2022-01-19T07:19:40.157 INFO:teuthology.dispatcher.supervisor:Running job 6625608 2022-01-19T07:19:40.158 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-18_22:38:16-rados-wip-yuri2-testing-2022-01-18-1151-pacific-distro-default-smithi/6625608 --name yuriw-2022-01-18_22:38:16-rados-wip-yuri2-testing-2022-01-18-1151-pacific-distro-default-smithi --description rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/yuriw-2022-01-18_22:38:16-rados-wip-yuri2-testing-2022-01-18-1151-pacific-distro-default-smithi/6625608/orig.config.yaml 2022-01-19T07:19:40.162 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-18_22:38:16-rados-wip-yuri2-testing-2022-01-18-1151-pacific-distro-default-smithi/6625608 2022-01-19T07:19:40.163 INFO:teuthology.dispatcher.supervisor:Job PID: 31364 2022-01-19T07:19:40.163 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-19T13:50:08.807 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-19T13:50:09.002 INFO:teuthology.kill:Killing Pids: {31364} 2022-01-19T13:50:10.270 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-19T13:50:10.271 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-19T13:50:10.272 INFO:teuthology.misc:Compressing logs... 2022-01-19T13:50:10.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2022-01-19T13:50:10.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2022-01-19T13:50:10.531 INFO:teuthology.orchestra.run.smithi001.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-19T13:50:10.826 INFO:teuthology.orchestra.run.smithi006.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-19T13:50:10.848 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-19T13:50:10.848 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now 2022-01-19T13:50:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-19T13:50:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now 2022-01-19T13:50:10.887 INFO:teuthology.misc:Compressing logs... 2022-01-19T13:50:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-01-19T13:50:11.203 INFO:teuthology.misc:Compressing logs... 2022-01-19T13:50:13.308 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-19T13:50:13.439 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-19T13:50:15.275 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-19T13:50:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-mon.smithi006.log: file size changed while zipping 2022-01-19T13:50:18.813 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-19T13:50:20.670 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-19T13:50:22.489 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-19T13:50:24.908 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-mon.smithi001.log: file size changed while zipping 2022-01-19T13:50:29.367 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-mgr.smithi001.nzjzat.log: file size changed while zipping 2022-01-19T13:50:31.397 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/1312c85c-78f9-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-19T13:50:37.955 INFO:teuthology.kill:No teuthology processes running 2022-01-19T13:50:39.148 INFO:teuthology.kill:Nuking machines: ['smithi001', 'smithi006'] 2022-01-19T13:50:40.133 INFO:teuthology.kill:2022-01-19 13:50:40,132.132 INFO:teuthology.nuke:targets: 2022-01-19T13:50:40.417 INFO:teuthology.kill: smithi001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLDa2S7ckFI1LOGfCbaSevmDgYGKnF0/Py8yz+8JQNZA3df8SFVS5krmwZDwE62pM0uVAkB0XWlx2OsEcJAPejwU2e/1N/vjIb+RBZR1yzKxxBKLgCLvfb1NReIhcbdx2KijsWBYSE9ZsQ7+sSod/ISgGZuRMxUScAMZycVblWTDfoNav9ysSs8B1yCGIwRlCtoFt4kd1lH0I3Bem6LPtcZ7UEO9rDq6ytrZPPOZCAffxYyoxPo5ivEHGYEApPqLlrOy+I6owxe00P17dvf4p1AyZ91nC6iWLrgDOnz9XhQ7BNtOGvfcXL1qkfIUjndR63o0Y7uJmK3ljiRG+cpFp9 2022-01-19T13:50:40.417 INFO:teuthology.kill: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUFD7QZeLr5Oz0PlQ+SROG/WGNWk23L9x29nVOX35jYWoZBcFLFEatVojWK4w7nGQwp4kLB9wsdWNW5q5KyAJ85xVtxUZomPcsI+IiD9ZiuwIcQ0p1hMOtovuua3yrQH+nDZlfc4f7pwjJVv+lRilMtfG54YpTGbM0GxlX5wnFcjKpznR0lR4H8uzvVBGsqwB0FhleC6pB1jlm/uAWaUhKOXwwaT2W4YoHpFkdDa84/9E7HxlGelxvIkBPb3iVEkwUByud5UXPDvr/oiR8zQ4BHXYZtlIDAQIMmORbiVhxmI24jTYHCnlwJPfz4txy74arV7u9NY26lD6xdtnknq0l 2022-01-19T13:50:40.417 INFO:teuthology.kill:2022-01-19 13:50:40,160.160 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-19T13:50:40.418 INFO:teuthology.kill:2022-01-19 13:50:40,168.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-19T13:50:40.418 INFO:teuthology.kill:2022-01-19 13:50:40,263.263 INFO:teuthology.orchestra.console:Power off smithi001 2022-01-19T13:50:40.418 INFO:teuthology.kill:2022-01-19 13:50:40,277.277 INFO:teuthology.orchestra.console:Power off smithi006 2022-01-19T13:50:48.642 INFO:teuthology.kill:2022-01-19 13:50:48,641.641 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2022-01-19T13:50:48.787 INFO:teuthology.kill:2022-01-19 13:50:48,786.786 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2022-01-19T13:50:52.746 INFO:teuthology.kill:2022-01-19 13:50:52,746.746 INFO:teuthology.orchestra.console:Power off for smithi001 completed 2022-01-19T13:50:52.893 INFO:teuthology.kill:2022-01-19 13:50:52,892.892 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com 2022-01-19T13:52:53.217 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-19T13:52:53.325 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi001 but it was locked by another job: /home/teuthworker/archive/dang-2022-01-19_08:34:08-rgw-wip-dang-zipper-objctx-distro-basic-smithi/6627286 2022-01-19T13:52:53.325 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi006 but it was locked by another job: /home/teuthworker/archive/dang-2022-01-19_08:34:08-rgw-wip-dang-zipper-objctx-distro-basic-smithi/6627286