2022-02-03T22:13:33.315 INFO:root:teuthology version: 1.1.0-3094160c
2022-02-03T22:13:33.443 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi031.front.sepia.ceph.com' reimaging
2022-02-03T22:13:33.445 INFO:teuthology.lock.ops:Updating [ubuntu@smithi031.front.sepia.ceph.com]: reset os type and version on server
2022-02-03T22:13:33.445 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2022-02-03T22:13:33.464 INFO:teuthology.lock.ops:Node 'ubuntu@smithi031.front.sepia.ceph.com' reimaging is complete
2022-02-03T22:13:33.464 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi135.front.sepia.ceph.com' reimaging
2022-02-03T22:13:33.465 INFO:teuthology.lock.ops:Updating [ubuntu@smithi135.front.sepia.ceph.com]: reset os type and version on server
2022-02-03T22:13:33.465 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2022-02-03T22:13:33.483 INFO:teuthology.lock.ops:Node 'ubuntu@smithi135.front.sepia.ceph.com' reimaging is complete
2022-02-03T22:13:33.701 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of ubuntu 20.04
2022-02-03T22:13:33.705 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of ubuntu 20.04
2022-02-03T22:13:34.206 INFO:teuthology.orchestra.console:Power off smithi135
2022-02-03T22:13:34.224 INFO:teuthology.orchestra.console:Power off smithi031
2022-02-03T22:13:42.585 INFO:teuthology.orchestra.console:Power off for smithi135 completed
2022-02-03T22:13:42.687 INFO:teuthology.orchestra.console:Power on smithi135
2022-02-03T22:13:46.706 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2022-02-03T22:13:46.807 INFO:teuthology.orchestra.console:Power on smithi031
2022-02-03T22:13:51.098 INFO:teuthology.orchestra.console:Power on for smithi135 completed
2022-02-03T22:13:51.199 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish
2022-02-03T22:13:55.180 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2022-02-03T22:13:55.282 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2022-02-03T22:18:17.613 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-03T22:18:18.062 INFO:teuthology.provision.fog.smithi031:Node is ready
2022-02-03T22:18:18.069 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2022-02-03T22:18:18.076 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2022-02-03T22:18:18.246 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2022-02-03T22:18:59.117 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-03T22:18:59.673 INFO:teuthology.provision.fog.smithi135:Node is ready
2022-02-03T22:18:59.679 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com
2022-02-03T22:18:59.729 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135
2022-02-03T22:18:59.922 INFO:teuthology.provision.fog.smithi135:Deploy complete!
2022-02-03T22:19:00.134 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2022-02-03T22:19:00.135 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-03T22:19:00.153 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com
2022-02-03T22:19:00.154 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-03T22:19:00.171 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2022-02-03T22:19:00.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2022-02-03T22:19:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2022-02-03T22:19:00.365 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu"
2022-02-03T22:19:00.365 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-03T22:19:00.366 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu
2022-02-03T22:19:00.366 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian
2022-02-03T22:19:00.366 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-03T22:19:00.366 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04"
2022-02-03T22:19:00.367 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-03T22:19:00.367 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-03T22:19:00.367 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-03T22:19:00.367 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-03T22:19:00.367 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal
2022-02-03T22:19:00.368 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal
2022-02-03T22:19:00.369 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2022-02-03T22:19:00.388 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server
2022-02-03T22:19:00.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2022-02-03T22:19:00.553 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64
2022-02-03T22:19:00.560 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Ubuntu"
2022-02-03T22:19:00.560 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-02-03T22:19:00.560 INFO:teuthology.orchestra.run.smithi135.stdout:ID=ubuntu
2022-02-03T22:19:00.560 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE=debian
2022-02-03T22:19:00.561 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-02-03T22:19:00.561 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="20.04"
2022-02-03T22:19:00.561 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.ubuntu.com/"
2022-02-03T22:19:00.561 INFO:teuthology.orchestra.run.smithi135.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-02-03T22:19:00.561 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-02-03T22:19:00.562 INFO:teuthology.orchestra.run.smithi135.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-02-03T22:19:00.562 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_CODENAME=focal
2022-02-03T22:19:00.562 INFO:teuthology.orchestra.run.smithi135.stdout:UBUNTU_CODENAME=focal
2022-02-03T22:19:00.563 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2022-02-03T22:19:00.670 INFO:teuthology.dispatcher.supervisor:Running job 6659608
2022-02-03T22:19:00.671 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3094160cc590b786a43d55faaf7c99d5de71ce56/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-02-03_22:11:02-orch:cephadm-wip-adk-testing-2022-02-03-0853-distro-basic-smithi/6659608 --name adking-2022-02-03_22:11:02-orch:cephadm-wip-adk-testing-2022-02-03-0853-distro-basic-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} -- /home/teuthworker/archive/adking-2022-02-03_22:11:02-orch:cephadm-wip-adk-testing-2022-02-03-0853-distro-basic-smithi/6659608/orig.config.yaml
2022-02-03T22:19:00.674 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-02-03_22:11:02-orch:cephadm-wip-adk-testing-2022-02-03-0853-distro-basic-smithi/6659608
2022-02-03T22:19:00.674 INFO:teuthology.dispatcher.supervisor:Job PID: 7014
2022-02-03T22:19:00.675 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-04T04:49:11.607 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-04T04:49:11.785 INFO:teuthology.kill:Killing Pids: {7014}
2022-02-04T04:49:12.954 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2022-02-04T04:49:12.955 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2022-02-04T04:49:12.955 INFO:teuthology.misc:Compressing logs...
2022-02-04T04:49:12.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2022-02-04T04:49:13.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2022-02-04T04:49:13.158 INFO:teuthology.orchestra.run.smithi031.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-02-04T04:49:13.336 INFO:teuthology.orchestra.run.smithi135.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-02-04T04:49:13.361 INFO:teuthology.orchestra.run.smithi031.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-04T04:49:13.362 INFO:teuthology.orchestra.run.smithi031.stderr:tar: Error is not recoverable: exiting now
2022-02-04T04:49:13.379 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-04T04:49:13.380 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now
2022-02-04T04:49:13.382 INFO:teuthology.misc:Compressing logs...
2022-02-04T04:49:13.745 INFO:teuthology.misc:Compressing logs...
2022-02-04T04:49:16.320 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2022-02-04T04:49:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-02-04T04:49:33.948 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-02-04T04:49:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-02-04T04:49:41.936 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-02-04T04:49:45.870 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-02-04T04:49:52.440 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-02-04T04:49:56.000 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-02-04T04:50:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-02-04T04:50:07.531 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-02-04T04:50:20.650 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-02-04T04:50:31.721 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/b85f1304-853f-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-02-04T04:51:04.021 INFO:teuthology.kill:No teuthology processes running
2022-02-04T04:51:05.100 INFO:teuthology.kill:Nuking machines: ['smithi031', 'smithi135']
2022-02-04T04:51:06.024 INFO:teuthology.kill:2022-02-04 04:51:06,024.024 INFO:teuthology.nuke:targets:
2022-02-04T04:51:06.025 INFO:teuthology.kill:  smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7ddXgdigNqt1lDFJlelhLbBUndGmhYfCeWnHpd+QZFUC7rpRyvf2I7Q9eKsWLRNC1ZOvwtLb9voYG/D04pbR25ey0TRefH1sZ6EDSLpCznP/WTnoSKXAu+IW+vqr4I9zlnb0hfpL6TNiu5gb4B78uKtTMk5kJ2XKZl9M1xjtCzMRFF9+A8DmWAcRxwp3NgFIzirlnTtuJ46P0BQGGN/2A4/lKHi4WWjMebqA72kFUy9NVZrwbmZSlGicgHdyCcyM2LAnaKpe7d+G5WyaoGynFjHSI/V3Wu5w0vK6sm0rxQh+5HPOebWbQOitBj01YE1qSQ9wUC7Z5Vu3Il9XQJIQW6k2x+9+EF7TPGVh6MSeIw8ZJR+LuX0f9h40BV/SPCpFDYwyQ+pnIioAb4UIQ3Mqo0OFmEvwFJJTYi9jaxxvDlaReATT8t/iGKl6ufyTQm9ortdsqJ2885/pA4iykkcsBOWX67q0cydoIQcyWrdLrmRQPuvSJd/Dfib4JUSfp4bs=
2022-02-04T04:51:06.026 INFO:teuthology.kill:  smithi135.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC947XUeAA3eEUjyW3vt8XQwHoM8uwcBS1FQtXIzaYw4y48S5++/3SGCyKfnu9HHsa8C6SWhiax1IPeRiXoD8oUTw7RSXf2JjY7V43gOIJFvSaqi12BYi4pMPxrCfA8zvpK7xk5nAnJPnRq1xQYN5cETA1vbvSSDG7nQ/K0+8CFUhhufQ3YIbZTndDf6Ud90y4xT9kSMa3Q7QMDZduA0xvnV3yHQu7V5nD/aTI4UgD0tR7b6xjnhfOsM2TcAkIR9GVPyce6pi4zTSDdSi8FjNmRhFmKKZKoIydEb6cgb9zKSUe77zTVxPy7d9auuYo1JMhsVwCF4vNOKF7b45TPwwI4eo7t3HWTK60VfkfWgegTwQ2cUHe3KZsOJU2B/fKo7QTQC6i8LVfBtEjaur2waKWPJuV+Wa8QMghEsILzATQu8je/Kho/FZJOy8BO47QibI5FBum31qUReIfEUuvhZgO83Dj1X7b1EizQwUBqVwo1aDads1ivcnwNDudOq3rEVzM=
2022-02-04T04:51:06.051 INFO:teuthology.kill:2022-02-04 04:51:06,051.051 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-04T04:51:06.055 INFO:teuthology.kill:2022-02-04 04:51:06,055.055 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-04T04:51:06.131 INFO:teuthology.kill:2022-02-04 04:51:06,131.131 INFO:teuthology.orchestra.console:Power off smithi135
2022-02-04T04:51:06.145 INFO:teuthology.kill:2022-02-04 04:51:06,144.144 INFO:teuthology.orchestra.console:Power off smithi031
2022-02-04T04:51:14.504 INFO:teuthology.kill:2022-02-04 04:51:14,503.503 INFO:teuthology.orchestra.console:Power off for smithi135 completed
2022-02-04T04:51:14.648 INFO:teuthology.kill:2022-02-04 04:51:14,647.647 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com
2022-02-04T04:51:18.622 INFO:teuthology.kill:2022-02-04 04:51:18,622.622 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2022-02-04T04:51:18.766 INFO:teuthology.kill:2022-02-04 04:51:18,766.766 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2022-02-04T04:53:19.045 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-04T04:53:19.133 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi031 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-04_00:05:59-rados-wip-yuri-testing-2022-02-03-1333-distro-default-smithi/6660226
2022-02-04T04:53:19.133 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi135 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-04_00:05:59-rados-wip-yuri-testing-2022-02-03-1333-distro-default-smithi/6660226