2021-11-02T09:32:50.485 INFO:root:teuthology version: 1.1.0-c56135d1
2021-11-02T09:32:50.609 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi038.front.sepia.ceph.com' reimaging
2021-11-02T09:32:50.610 INFO:teuthology.lock.ops:Updating [ubuntu@smithi038.front.sepia.ceph.com]: reset os type and version on server
2021-11-02T09:32:50.611 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2021-11-02T09:32:50.631 INFO:teuthology.lock.ops:Node 'ubuntu@smithi038.front.sepia.ceph.com' reimaging is complete
2021-11-02T09:32:50.631 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging
2021-11-02T09:32:50.632 INFO:teuthology.lock.ops:Updating [ubuntu@smithi039.front.sepia.ceph.com]: reset os type and version on server
2021-11-02T09:32:50.632 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2021-11-02T09:32:50.650 INFO:teuthology.lock.ops:Node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging is complete
2021-11-02T09:32:50.836 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of ubuntu 20.04
2021-11-02T09:32:50.857 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of ubuntu 20.04
2021-11-02T09:32:51.243 INFO:teuthology.orchestra.console:Power off smithi038
2021-11-02T09:32:51.259 INFO:teuthology.orchestra.console:Power off smithi039
2021-11-02T09:32:51.403 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2021-11-02T09:32:51.504 INFO:teuthology.orchestra.console:Power on smithi039
2021-11-02T09:32:55.786 INFO:teuthology.orchestra.console:Power on for smithi039 completed
2021-11-02T09:32:55.887 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2021-11-02T09:32:59.631 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2021-11-02T09:32:59.732 INFO:teuthology.orchestra.console:Power on smithi038
2021-11-02T09:33:08.095 INFO:teuthology.orchestra.console:Power on for smithi038 completed
2021-11-02T09:33:08.196 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish
2021-11-02T09:38:43.454 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-02T09:38:44.046 INFO:teuthology.provision.fog.smithi038:Node is ready
2021-11-02T09:38:44.053 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com
2021-11-02T09:38:44.060 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038
2021-11-02T09:38:44.282 INFO:teuthology.provision.fog.smithi038:Deploy complete!
2021-11-02T09:38:46.232 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-02T09:38:46.773 INFO:teuthology.provision.fog.smithi039:Node is ready
2021-11-02T09:38:46.780 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com
2021-11-02T09:38:46.828 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039
2021-11-02T09:38:47.026 INFO:teuthology.provision.fog.smithi039:Deploy complete!
2021-11-02T09:38:47.209 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com
2021-11-02T09:38:47.210 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-02T09:38:47.229 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com
2021-11-02T09:38:47.230 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-02T09:38:47.249 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server
2021-11-02T09:38:47.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2021-11-02T09:38:47.439 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64
2021-11-02T09:38:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Ubuntu"
2021-11-02T09:38:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-11-02T09:38:47.446 INFO:teuthology.orchestra.run.smithi038.stdout:ID=ubuntu
2021-11-02T09:38:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE=debian
2021-11-02T09:38:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-11-02T09:38:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="20.04"
2021-11-02T09:38:47.447 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.ubuntu.com/"
2021-11-02T09:38:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-11-02T09:38:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-11-02T09:38:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-11-02T09:38:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_CODENAME=focal
2021-11-02T09:38:47.448 INFO:teuthology.orchestra.run.smithi038.stdout:UBUNTU_CODENAME=focal
2021-11-02T09:38:47.449 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2021-11-02T09:38:47.468 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server
2021-11-02T09:38:47.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2021-11-02T09:38:47.647 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64
2021-11-02T09:38:47.654 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu"
2021-11-02T09:38:47.654 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-11-02T09:38:47.654 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu
2021-11-02T09:38:47.654 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian
2021-11-02T09:38:47.655 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-11-02T09:38:47.655 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="20.04"
2021-11-02T09:38:47.655 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/"
2021-11-02T09:38:47.655 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-11-02T09:38:47.656 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-11-02T09:38:47.656 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-11-02T09:38:47.656 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=focal
2021-11-02T09:38:47.656 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=focal
2021-11-02T09:38:47.657 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2021-11-02T09:38:47.750 INFO:teuthology.dispatcher.supervisor:Running job 6474784
2021-11-02T09:38:47.750 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_pdiazbou@teuthology --archive /home/teuthworker/archive/pdiazbou-2021-11-02_04:20:02-orch-wip-pereman2-testing-2021-11-01-2310-distro-basic-smithi/6474784 --name pdiazbou-2021-11-02_04:20:02-orch-wip-pereman2-testing-2021-11-01-2310-distro-basic-smithi --description orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} -- /home/teuthworker/archive/pdiazbou-2021-11-02_04:20:02-orch-wip-pereman2-testing-2021-11-01-2310-distro-basic-smithi/6474784/orig.config.yaml
2021-11-02T09:38:47.754 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdiazbou-2021-11-02_04:20:02-orch-wip-pereman2-testing-2021-11-01-2310-distro-basic-smithi/6474784
2021-11-02T09:38:47.755 INFO:teuthology.dispatcher.supervisor:Job PID: 20317
2021-11-02T09:38:47.755 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-02T21:39:42.115 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-02T21:39:42.308 INFO:teuthology.kill:Killing Pids: {20317}
2021-11-02T21:39:43.637 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-11-02T21:39:43.639 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-11-02T21:39:43.639 INFO:teuthology.misc:Compressing logs...
2021-11-02T21:39:43.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2021-11-02T21:39:43.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com'
2021-11-02T21:39:43.849 INFO:teuthology.orchestra.run.smithi038.stderr:find: '/var/lib/ceph/crash': No such file or directory
2021-11-02T21:39:44.071 INFO:teuthology.orchestra.run.smithi039.stderr:find: '/var/lib/ceph/crash': No such file or directory
2021-11-02T21:39:44.100 INFO:teuthology.orchestra.run.smithi038.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-11-02T21:39:44.100 INFO:teuthology.orchestra.run.smithi038.stderr:tar: Error is not recoverable: exiting now
2021-11-02T21:39:44.121 INFO:teuthology.orchestra.run.smithi039.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-11-02T21:39:44.122 INFO:teuthology.orchestra.run.smithi039.stderr:tar: Error is not recoverable: exiting now
2021-11-02T21:39:44.124 INFO:teuthology.misc:Compressing logs...
2021-11-02T21:39:44.837 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-11-02T21:39:44.858 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-11-02T21:39:45.328 INFO:teuthology.misc:Compressing logs...
2021-11-02T21:39:45.579 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-mgr.x.log: file size changed while zipping
2021-11-02T21:40:03.876 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-02T21:40:08.171 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-11-02T21:40:15.064 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2021-11-02T21:40:36.420 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-02T21:40:42.226 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-02T21:40:51.684 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2021-11-02T21:41:00.752 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-11-02T21:41:08.921 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2021-11-02T21:41:28.884 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2021-11-02T21:41:37.728 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/cee6f456-3bc1-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-02T21:42:31.188 INFO:teuthology.kill:No teuthology processes running
2021-11-02T21:42:32.373 INFO:teuthology.kill:Nuking machines: ['smithi038', 'smithi039']
2021-11-02T21:42:33.325 INFO:teuthology.kill:2021-11-02 21:42:33,325.325 INFO:teuthology.nuke:targets:
2021-11-02T21:42:33.326 INFO:teuthology.kill:  smithi038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt7safg7B9pc0rnjOv5xCc0DVH0nOXa81qfjoznAoayOm+RMRMYllx4zGNxdP6QC4JVpY8lmjyOwa2xP7w6rVHSk53gDkEY0tc0G+ssc3zrb+sDgsaIAI0ZnxKv4LF0mVlb+YfrLcbl+A/jE2JgM61Z37UhIyt3yyq6RmLabJvWfjtnuiJtsEDQbz62BStqnDXxYkMFT53zvSIon/b8GLfxjnoA3Rzsh0MReyDRrbEXdsRPaljHGyWwKRMZmeYqoZXu42Mb0urljsNsv6W3NyPObCW6fYQIqdYhg1BpfYhoHZPd61L8CEyPpz/VDS+zWMtBdyE2nZTs6wStzP5gQz4x4JWEdWM/+gqe2hS1uHsJxRpziaCxePt22Xpd1gcfBGGznD66LhQoAy2/QFYN5/FV+b69LX9UQPTSHDKVuNksDTCrtTOO0HttwhkZQn6S5k1bGLw3k9UiJ2mcQynS66lfmYpcZk/kXU7r8DYDjjPh0oYQMt1kBbMyP+lOR++bDk=
2021-11-02T21:42:33.327 INFO:teuthology.kill:  smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn4Ifplfi+v0W9D3WQC5y6r9ybnPyQCB59gsOXKb9QS4PP8xsHOtvmj+rUC4aPYQmAS5AiJ5vADTBJ0MA43hZAS47bLUT2Dgr9q8a8AxKbBlv3CTBBcnFeJBl0RayEZ0O6MH60DUDAAtgyq1+CGGNb2OvVu8MJ0XZdDoL/lxjLQqiHMxk0ElyeycQkmqYUgND1tt1eiI6MSaSrv9vKwMZ+TekWeOShvn9Tw/OYi4kHuoMzudvrXoR8UfmBTDr2owlVyyRo23oWvfv6c2uBBbRvlhoVQJyNZdC4mcmHSYbCdK5Aj5gM2nQ3hmFqIz5cnKFM/ozNv+ek0Vu7Hf41SZXd62KhfvSvPZjq3txFpaiMiWcLYUnsCyl/2ac9EaK6KIXY+ql1fwkk69ueOFb/Lv6nkwi1I8ZajJwlP4cGbbMD6H8gp8ikcFQWfRyDimjmquBVotrFJhJVlwlsAhPh7OXutT+sAF2LhhlklrOG9Gb9v7cni7QIP8hB4RtYagSLvs0=
2021-11-02T21:42:33.352 INFO:teuthology.kill:2021-11-02 21:42:33,352.352 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-02T21:42:33.355 INFO:teuthology.kill:2021-11-02 21:42:33,355.355 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-02T21:42:33.435 INFO:teuthology.kill:2021-11-02 21:42:33,434.434 INFO:teuthology.orchestra.console:Power off smithi038
2021-11-02T21:42:33.446 INFO:teuthology.kill:2021-11-02 21:42:33,446.446 INFO:teuthology.orchestra.console:Power off smithi039
2021-11-02T21:42:41.809 INFO:teuthology.kill:2021-11-02 21:42:41,809.809 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2021-11-02T21:42:41.956 INFO:teuthology.kill:2021-11-02 21:42:41,955.955 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com
2021-11-02T21:42:45.915 INFO:teuthology.kill:2021-11-02 21:42:45,915.915 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2021-11-02T21:42:46.061 INFO:teuthology.kill:2021-11-02 21:42:46,061.061 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com
2021-11-02T21:44:46.302 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-02T21:44:46.391 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi038 but it was locked by another job: /home/teuthworker/archive/sage-2021-11-02_19:13:14-orch:cephadm-wip-sage-testing-2021-11-02-1245-distro-basic-smithi/6478672
2021-11-02T21:44:46.392 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi039 but it was locked by another job: /home/teuthworker/archive/sage-2021-11-02_19:13:14-orch:cephadm-wip-sage-testing-2021-11-02-1245-distro-basic-smithi/6478672