2021-11-17T11:02:36.503 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-17T11:02:36.650 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging 2021-11-17T11:02:36.651 INFO:teuthology.lock.ops:Updating [ubuntu@smithi160.front.sepia.ceph.com]: reset os type and version on server 2021-11-17T11:02:36.651 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2021-11-17T11:02:36.679 INFO:teuthology.lock.ops:Node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging is complete 2021-11-17T11:02:36.680 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging 2021-11-17T11:02:36.680 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server 2021-11-17T11:02:36.681 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2021-11-17T11:02:36.701 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete 2021-11-17T11:02:36.891 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of ubuntu 20.04 2021-11-17T11:02:36.929 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04 2021-11-17T11:02:37.325 INFO:teuthology.orchestra.console:Power off smithi160 2021-11-17T11:02:37.374 INFO:teuthology.orchestra.console:Power off smithi163 2021-11-17T11:02:45.714 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2021-11-17T11:02:45.739 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2021-11-17T11:02:45.815 INFO:teuthology.orchestra.console:Power on smithi160 2021-11-17T11:02:45.846 INFO:teuthology.orchestra.console:Power on smithi163 2021-11-17T11:02:50.073 INFO:teuthology.orchestra.console:Power on for smithi160 completed 2021-11-17T11:02:50.174 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2021-11-17T11:02:54.212 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2021-11-17T11:02:54.314 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2021-11-17T11:08:25.364 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-17T11:08:25.885 INFO:teuthology.provision.fog.smithi160:Node is ready 2021-11-17T11:08:25.891 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2021-11-17T11:08:25.899 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2021-11-17T11:08:26.106 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2021-11-17T11:08:44.469 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-17T11:08:44.989 INFO:teuthology.provision.fog.smithi163:Node is ready 2021-11-17T11:08:44.997 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2021-11-17T11:08:45.051 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2021-11-17T11:08:45.240 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2021-11-17T11:08:45.425 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2021-11-17T11:08:45.426 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-17T11:08:45.449 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2021-11-17T11:08:45.450 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-17T11:08:45.471 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2021-11-17T11:08:45.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2021-11-17T11:08:45.734 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2021-11-17T11:08:45.741 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2021-11-17T11:08:45.741 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-17T11:08:45.742 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2021-11-17T11:08:45.742 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2021-11-17T11:08:45.742 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-17T11:08:45.743 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="20.04" 2021-11-17T11:08:45.743 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-17T11:08:45.743 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-17T11:08:45.743 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-17T11:08:45.743 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-17T11:08:45.744 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=focal 2021-11-17T11:08:45.744 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=focal 2021-11-17T11:08:45.745 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2021-11-17T11:08:45.763 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2021-11-17T11:08:45.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2021-11-17T11:08:45.978 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2021-11-17T11:08:45.985 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2021-11-17T11:08:45.985 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-17T11:08:45.985 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2021-11-17T11:08:45.986 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2021-11-17T11:08:45.986 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-17T11:08:45.986 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="20.04" 2021-11-17T11:08:45.986 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-17T11:08:45.987 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-17T11:08:45.987 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-17T11:08:45.987 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-17T11:08:45.987 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=focal 2021-11-17T11:08:45.988 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=focal 2021-11-17T11:08:45.988 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2021-11-17T11:08:46.088 INFO:teuthology.dispatcher.supervisor:Running job 6506882 2021-11-17T11:08:46.088 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-16_19:01:03-rados-wip-yuri11-testing-2021-11-16-0713-octopus-distro-basic-smithi/6506882 --name yuriw-2021-11-16_19:01:03-rados-wip-yuri11-testing-2021-11-16-0713-octopus-distro-basic-smithi --description rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged msgr/async start tasks/rados_python} -- /home/teuthworker/archive/yuriw-2021-11-16_19:01:03-rados-wip-yuri11-testing-2021-11-16-0713-octopus-distro-basic-smithi/6506882/orig.config.yaml 2021-11-17T11:08:46.093 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-16_19:01:03-rados-wip-yuri11-testing-2021-11-16-0713-octopus-distro-basic-smithi/6506882 2021-11-17T11:08:46.094 INFO:teuthology.dispatcher.supervisor:Job PID: 15045 2021-11-17T11:08:46.094 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-17T23:09:41.133 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-17T23:09:41.283 INFO:teuthology.kill:Killing Pids: {15045} 2021-11-17T23:09:42.463 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.realm.zone.a', 'node-exporter.a', 'alertmanager.a'] 2021-11-17T23:09:42.464 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-11-17T23:09:42.464 INFO:teuthology.misc:Compressing logs... 2021-11-17T23:09:42.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2021-11-17T23:09:42.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2021-11-17T23:09:42.945 INFO:teuthology.misc:Compressing logs... 2021-11-17T23:09:43.218 INFO:teuthology.misc:Compressing logs... 2021-11-17T23:09:47.149 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2021-11-17T23:09:47.414 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2021-11-17T23:09:50.994 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2021-11-17T23:09:51.299 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2021-11-17T23:09:55.177 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2021-11-17T23:09:57.625 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-mgr.y.log: file size changed while zipping 2021-11-17T23:09:59.228 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2021-11-17T23:10:01.412 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2021-11-17T23:10:03.142 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2021-11-17T23:10:05.293 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2021-11-17T23:10:09.962 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2021-11-17T23:10:26.262 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/00be9236-4798-11ec-8c2c-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2021-11-17T23:10:42.208 INFO:teuthology.kill:No teuthology processes running 2021-11-17T23:10:43.392 INFO:teuthology.kill:Nuking machines: ['smithi160', 'smithi163'] 2021-11-17T23:10:44.408 INFO:teuthology.kill:2021-11-17 23:10:44,407.407 INFO:teuthology.nuke:targets: 2021-11-17T23:10:44.409 INFO:teuthology.kill: smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD3IBA4US7iirnAztda8I27yzeIbbuImshNaSnyVRh/RKa6nZfQROAU9XrbpLfKhBbmd6i7clOIJwbOTnX4vjTLOnAjtM85NdtMSeOlfCDwm66a0/psKybASuq1LrMt5/ryf0Syo4buZSKE8PHTt9oIqXZiXc2DQq2S5AJxmFTi0vg3XR4aP6kiRy5GT1OL9eds/nOWRWPwyCJ7zXNoEqlh5o2MmwVV2um+gWLRtrtp1A/VpBiiD5rx8qka50MMcQUHCnKuqqDDvORc6fsVCeua1+rNCTd4cbgnLHRuWygilPmHPSBcXFXtaRx/45BSAEJzJNsaoCbVa9d8fDSlEb2t282/bpMyntcLxlfreg4kpIRyEBg9WeyemLW2JT08LzECyGSk56ZUvYLKolwC/1tSRFr3DrPKd9awXM/UYlA7SPEesiskI1JujlhDszy6WiiwZxu1ZLqxHxy/AKKhjjDhl6t5iitgsS1hV+ZgmqfptqMXdOXaG57JtdW7hclJgvc= 2021-11-17T23:10:44.409 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC7FzDMbrpkFJZutkSuii/ffKwcuu/TAj96Xgc9m1rBQIjeSNZLjB17Q7L4hmzUtu+bvMVmf3ynINE+OQRLO6UxhBEAib3nuDakr4bo3t1ziiDYKKkAZ8OGIOYAyhYwywtkuQ8nul0FBmwvGkD+MP1AfF2lMu1hLdobjKClCDyYe85Gb8s5L5lZktLECSHkxPo23Ja703O9GMtHrGW5DmyolbKlhVxpFxfPYAXz8572a6ZsTI9NVrKlQ16YorOAXlDNXIrwI5G0jkoUbPbknepSLntB9Zmx2dt7OHYKERWOKgFc3KPOickJJU3emu3+W0cUgU/E1FgV2FhWDm5aXO6jO5latSBxhKoaUYnAqGBoZTA7j7l6iABVI4Oa8jRepWbKcXHTkfUjHL06dA6MkBzcy86baVAdPimdiRRJrmP8IZOyb1t2mqj7r+xiVtWKLSr57Gg1agFg+pz6cIcllQpJd1N1klHjJf83toc7YCYJB2w4Ot5z2IiX7GgFdVtvIM= 2021-11-17T23:10:44.433 INFO:teuthology.kill:2021-11-17 23:10:44,433.433 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-17T23:10:44.436 INFO:teuthology.kill:2021-11-17 23:10:44,436.436 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-17T23:10:44.512 INFO:teuthology.kill:2021-11-17 23:10:44,511.511 INFO:teuthology.orchestra.console:Power off smithi160 2021-11-17T23:10:44.529 INFO:teuthology.kill:2021-11-17 23:10:44,528.528 INFO:teuthology.orchestra.console:Power off smithi163 2021-11-17T23:10:56.998 INFO:teuthology.kill:2021-11-17 23:10:56,997.997 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2021-11-17T23:10:57.003 INFO:teuthology.kill:2021-11-17 23:10:57,003.003 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2021-11-17T23:10:57.210 INFO:teuthology.kill:2021-11-17 23:10:57,209.209 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com 2021-11-17T23:10:57.214 INFO:teuthology.kill:2021-11-17 23:10:57,213.213 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2021-11-17T23:12:57.530 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-17T23:12:57.620 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi160 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-17_14:54:18-rbd-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi/6509781 2021-11-17T23:12:57.620 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-17_14:54:18-rbd-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi/6509781