2022-04-24T07:32:31.981 INFO:root:teuthology version: 1.1.1.dev313+g1b11219b
2022-04-24T07:32:32.108 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging
2022-04-24T07:32:32.109 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server
2022-04-24T07:32:32.109 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2022-04-24T07:32:32.127 INFO:teuthology.lock.ops:Node 'smithi047.front.sepia.ceph.com' reimaging is complete
2022-04-24T07:32:32.127 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2022-04-24T07:32:32.127 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2022-04-24T07:32:32.127 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-04-24T07:32:32.146 INFO:teuthology.lock.ops:Node 'smithi073.front.sepia.ceph.com' reimaging is complete
2022-04-24T07:32:32.336 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of ubuntu 20.04
2022-04-24T07:32:32.353 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of ubuntu 20.04
2022-04-24T07:32:32.689 INFO:teuthology.orchestra.console:Power off smithi047
2022-04-24T07:32:32.704 INFO:teuthology.orchestra.console:Power off smithi073
2022-04-24T07:32:41.063 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2022-04-24T07:32:41.069 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-04-24T07:32:41.165 INFO:teuthology.orchestra.console:Power on smithi047
2022-04-24T07:32:41.172 INFO:teuthology.orchestra.console:Power on smithi073
2022-04-24T07:32:45.423 INFO:teuthology.orchestra.console:Power on for smithi047 completed
2022-04-24T07:32:45.524 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish
2022-04-24T07:32:49.543 INFO:teuthology.orchestra.console:Power on for smithi073 completed
2022-04-24T07:32:49.644 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2022-04-24T07:37:20.816 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-24T07:37:21.393 INFO:teuthology.provision.fog.smithi047:Node is ready
2022-04-24T07:37:21.400 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com
2022-04-24T07:37:21.448 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047
2022-04-24T07:37:21.645 INFO:teuthology.provision.fog.smithi047:Deploy complete!
2022-04-24T07:37:41.397 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-24T07:37:41.908 INFO:teuthology.provision.fog.smithi073:Node is ready
2022-04-24T07:37:41.913 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2022-04-24T07:37:41.920 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2022-04-24T07:37:42.118 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2022-04-24T07:37:42.310 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com
2022-04-24T07:37:42.310 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-24T07:37:42.330 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2022-04-24T07:37:42.330 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-24T07:37:42.348 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server
2022-04-24T07:37:42.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2022-04-24T07:37:42.610 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64
2022-04-24T07:37:42.659 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu"
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="20.04"
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/"
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-04-24T07:37:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=focal
2022-04-24T07:37:42.661 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=focal
2022-04-24T07:37:42.662 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2022-04-24T07:37:42.683 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2022-04-24T07:37:42.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-04-24T07:37:42.858 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2022-04-24T07:37:42.865 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu"
2022-04-24T07:37:42.865 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-04-24T07:37:42.865 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="20.04"
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/"
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=focal
2022-04-24T07:37:42.866 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=focal
2022-04-24T07:37:42.867 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-04-24T07:37:42.957 INFO:teuthology.dispatcher.supervisor:Running job 6803295
2022-04-24T07:37:42.957 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b11219b9af33884aae5eb66700541df4b9620ed/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-04-24_03:31:03-rados-pacific-distro-default-smithi/6803295 --name teuthology-2022-04-24_03:31:03-rados-pacific-distro-default-smithi --description rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/teuthology-2022-04-24_03:31:03-rados-pacific-distro-default-smithi/6803295/orig.config.yaml
2022-04-24T07:37:42.960 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-04-24_03:31:03-rados-pacific-distro-default-smithi/6803295
2022-04-24T07:37:42.961 INFO:teuthology.dispatcher.supervisor:Job PID: 14743
2022-04-24T07:37:42.961 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-24T14:08:11.883 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-24T14:08:12.059 INFO:teuthology.kill:Killing Pids: {14743}
2022-04-24T14:08:13.441 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2022-04-24T14:08:13.441 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2022-04-24T14:08:13.441 INFO:teuthology.misc:Compressing logs...
2022-04-24T14:08:13.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2022-04-24T14:08:13.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-04-24T14:08:13.638 INFO:teuthology.orchestra.run.smithi047.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-04-24T14:08:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-04-24T14:08:13.876 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-04-24T14:08:13.876 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now
2022-04-24T14:08:13.895 INFO:teuthology.orchestra.run.smithi073.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-04-24T14:08:13.895 INFO:teuthology.orchestra.run.smithi073.stderr:tar: Error is not recoverable: exiting now
2022-04-24T14:08:13.897 INFO:teuthology.misc:Compressing logs...
2022-04-24T14:08:14.127 INFO:teuthology.misc:Compressing logs...
2022-04-24T14:08:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-04-24T14:08:26.512 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-04-24T14:08:28.536 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-04-24T14:08:36.664 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-04-24T14:08:39.672 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-04-24T14:08:43.492 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-04-24T14:08:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-04-24T14:08:56.880 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-04-24T14:08:58.223 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-04-24T14:09:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-04-24T14:09:05.442 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/4db1724e-c3a2-11ec-8c39-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-04-24T14:09:28.963 INFO:teuthology.kill:No teuthology processes running
2022-04-24T14:09:30.351 INFO:teuthology.kill:Nuking machines: ['smithi047', 'smithi073']
2022-04-24T14:09:31.510 INFO:teuthology.kill:2022-04-24 14:09:31,510.510 INFO:teuthology.nuke:targets:
2022-04-24T14:09:31.511 INFO:teuthology.kill:  smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC96PZ0a3Vg1AB5uAGESh2qoxkvogAa6J1Bm3C5Mhem5n7qE+1c/r5Q7dioV/TIgB4t64pxuntm656JaYPhJZ5jMJcOBzkkRHFcWWVlaS5byN3xz5PhGYs6hIOItpQoBEt6MSrctzawgE685Dd06TO+3XqAPA8LC7I1EkGSGHbD7z7DvDce0Ob7Ep2/Lpn/Gfwlai7axnlA4YV2mgicXEeL+hN9z8/kpEFv4wwLwq5S3s4L8fn9+5SvsxCP8Sh5Yogj/nGg1woolK1QZWcTpJttp7EdtMnWdDtuiHEdB1Oz4CDUcRCAALUcW6xGQz1mvybANXJAXrMF/VbgKf3hQw8FB9S/DYOF+cNt7U1EzROfMKGn82osBZi/V0kvpPZzetjRLxaL4KWJB7FcWb7CwHfTKM7dguNKlDjRMcPNyuY/7lAlX2G6nL6+Yd6n1jWFMzcPlidVYbtOJ1HsGiyTnCWXmpi5U8C+488QoDHe1SVQveqGwen1xMF6ZEHwH86SpeE=
2022-04-24T14:09:31.511 INFO:teuthology.kill:  smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3TVS5jct1AVUl3TayUGumuwjqxUIL+XI33iVkTbqudjH00w7SQq0qtIG5Wuq+Qpvck0igdy+4SjtKskF4c+pVE0Ro9ZwW33TKWdqDnbiOfWJp/RCXbAmRgl2cGWzxPNqwGLxOz05jbq4T+D7fiZZawBzRc1tr9ngMfVJhYEryxnWQo2qm4xqABPPJImos62i5B548pketlQKHizT2n8coqjbH6BCGSajxcbbyGGfyjFtgvUGHG+BtFx4bSlkO76QN9EuuhbA7e3ZSagCiTBWv4kCQ+QAZhSg/+qKz3D/LvbgQDbqyjMSaub/ZOMPlrPxE3lroNP2ZLY+tz7ovLU+sfRqHKceg0RP+v1k2MQOwUpVJQbqF5HaS7E7DA8G3wONQDdduEuOJJIat6y3VHahHx5s+fZhpkhCV6A/XvmCq/7EfuuzYOrgUK18oab1i60tj5g0Bxsc82mV9rv2b9lNCwsqHWh/8FUPJeg9Ty1xzAdxtLe+nfTo4m5PJbwBvZK0=
2022-04-24T14:09:31.537 INFO:teuthology.kill:2022-04-24 14:09:31,537.537 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-24T14:09:31.539 INFO:teuthology.kill:2022-04-24 14:09:31,539.539 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-24T14:09:31.612 INFO:teuthology.kill:2022-04-24 14:09:31,612.612 INFO:teuthology.orchestra.console:Power off smithi047
2022-04-24T14:09:31.624 INFO:teuthology.kill:2022-04-24 14:09:31,624.624 INFO:teuthology.orchestra.console:Power off smithi073
2022-04-24T14:09:39.983 INFO:teuthology.kill:2022-04-24 14:09:39,982.982 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-04-24T14:09:40.131 INFO:teuthology.kill:2022-04-24 14:09:40,130.130 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com
2022-04-24T14:09:44.091 INFO:teuthology.kill:2022-04-24 14:09:44,091.091 INFO:teuthology.orchestra.console:Power off for smithi047 completed
2022-04-24T14:09:44.234 INFO:teuthology.kill:2022-04-24 14:09:44,234.234 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com
2022-04-24T14:11:44.547 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-24T14:11:44.627 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi047 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-24_07:01:03-rados-quincy-distro-default-smithi/6803904
2022-04-24T14:11:44.627 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-24_07:01:03-rados-quincy-distro-default-smithi/6803903