2021-02-06T22:15:39.005 INFO:root:teuthology version: 1.1.0-17c09965
2021-02-06T22:15:39.115 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi086.front.sepia.ceph.com' reimaging
2021-02-06T22:15:39.116 INFO:teuthology.lock.ops:Updating [ubuntu@smithi086.front.sepia.ceph.com]: reset os type and version on server
2021-02-06T22:15:39.116 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2021-02-06T22:15:39.132 INFO:teuthology.lock.ops:Node 'ubuntu@smithi086.front.sepia.ceph.com' reimaging is complete
2021-02-06T22:15:39.133 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging
2021-02-06T22:15:39.133 INFO:teuthology.lock.ops:Updating [ubuntu@smithi105.front.sepia.ceph.com]: reset os type and version on server
2021-02-06T22:15:39.133 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2021-02-06T22:15:39.149 INFO:teuthology.lock.ops:Node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging is complete
2021-02-06T22:15:39.360 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of ubuntu 20.04
2021-02-06T22:15:39.393 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of ubuntu 20.04
2021-02-06T22:15:39.809 INFO:teuthology.orchestra.console:Power off smithi086
2021-02-06T22:15:39.848 INFO:teuthology.orchestra.console:Power off smithi105
2021-02-06T22:15:39.957 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2021-02-06T22:15:39.989 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-02-06T22:15:40.059 INFO:teuthology.orchestra.console:Power on smithi086
2021-02-06T22:15:40.091 INFO:teuthology.orchestra.console:Power on smithi105
2021-02-06T22:15:44.347 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2021-02-06T22:15:44.448 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2021-02-06T22:15:48.426 INFO:teuthology.orchestra.console:Power on for smithi086 completed
2021-02-06T22:15:48.528 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish
2021-02-06T22:20:50.617 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-06T22:20:51.202 INFO:teuthology.provision.fog.smithi086:Node is ready
2021-02-06T22:20:51.209 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086
2021-02-06T22:20:51.217 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086
2021-02-06T22:20:51.428 INFO:teuthology.provision.fog.smithi086:Deploy complete!
2021-02-06T22:21:01.441 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-06T22:21:01.962 INFO:teuthology.provision.fog.smithi105:Node is ready
2021-02-06T22:21:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105
2021-02-06T22:21:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2021-02-06T22:21:02.201 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2021-02-06T22:21:02.346 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com
2021-02-06T22:21:02.347 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-06T22:21:02.363 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2021-02-06T22:21:02.363 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-06T22:21:02.378 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server
2021-02-06T22:21:02.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-06T22:21:02.613 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64
2021-02-06T22:21:02.620 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu"
2021-02-06T22:21:02.620 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-02-06T22:21:02.620 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu
2021-02-06T22:21:02.621 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian
2021-02-06T22:21:02.621 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-02-06T22:21:02.621 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="20.04"
2021-02-06T22:21:02.621 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/"
2021-02-06T22:21:02.621 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-02-06T22:21:02.622 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-02-06T22:21:02.622 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-02-06T22:21:02.622 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=focal
2021-02-06T22:21:02.624 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=focal
2021-02-06T22:21:02.625 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2021-02-06T22:21:02.641 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2021-02-06T22:21:02.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-06T22:21:02.866 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2021-02-06T22:21:02.872 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu"
2021-02-06T22:21:02.873 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-02-06T22:21:02.873 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu
2021-02-06T22:21:02.873 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian
2021-02-06T22:21:02.874 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-02-06T22:21:02.874 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="20.04"
2021-02-06T22:21:02.874 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/"
2021-02-06T22:21:02.874 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-02-06T22:21:02.874 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-02-06T22:21:02.875 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-02-06T22:21:02.875 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=focal
2021-02-06T22:21:02.875 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=focal
2021-02-06T22:21:02.876 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2021-02-06T22:21:02.952 INFO:teuthology.dispatcher.supervisor:Running job 5862437
2021-02-06T22:21:02.952 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862437 --name yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi --description rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_20.04_podman} fixed-2 mon_election/connectivity} -- /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862437/orig.config.yaml
2021-02-06T22:21:02.955 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862437
2021-02-06T22:21:02.956 INFO:teuthology.dispatcher.supervisor:Job PID: 26107
2021-02-06T22:21:02.956 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-07T10:21:19.061 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-07T10:21:19.756 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-02-07T10:21:19.779 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-02-07T10:21:19.779 INFO:teuthology.misc:Compressing logs...
2021-02-07T10:21:19.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-07T10:21:20.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-07T10:21:20.852 INFO:teuthology.orchestra.run.smithi086.stderr:find: '/var/lib/ceph/crash': No such file or directory
2021-02-07T10:21:21.769 INFO:teuthology.orchestra.run.smithi105.stderr:find: '/var/lib/ceph/crash': No such file or directory
2021-02-07T10:21:21.793 INFO:teuthology.orchestra.run.smithi086.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-02-07T10:21:21.793 INFO:teuthology.orchestra.run.smithi086.stderr:tar: Error is not recoverable: exiting now
2021-02-07T10:21:21.813 INFO:teuthology.orchestra.run.smithi105.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-02-07T10:21:21.814 INFO:teuthology.orchestra.run.smithi105.stderr:tar: Error is not recoverable: exiting now
2021-02-07T10:21:21.820 INFO:teuthology.misc:Compressing logs...
2021-02-07T10:21:25.319 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-02-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-02-07T10:21:30.201 INFO:teuthology.misc:Compressing logs...
2021-02-07T10:22:37.672 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2021-02-07T10:23:09.376 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2021-02-07T10:23:49.072 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-02-07T10:24:34.412 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-mgr.x.log: file size changed while zipping
2021-02-07T10:25:56.384 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-02-07T10:26:45.989 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2021-02-07T10:27:24.101 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-02-07T10:28:15.275 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-02-07T10:28:51.201 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-02-07T10:29:54.067 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-02-07T10:31:52.635 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-02-07T10:33:58.371 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/f19fa0e0-68c9-11eb-8fdb-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-02-07T10:35:14.997 INFO:teuthology.orchestra.run.smithi086.stderr:tar: ./f19fa0e0-68c9-11eb-8fdb-001a4aab830c: file changed as we read it
2021-02-07T10:36:02.241 INFO:teuthology.orchestra.run.smithi105.stderr:tar: ./f19fa0e0-68c9-11eb-8fdb-001a4aab830c: file changed as we read it
2021-02-07T10:36:02.424 INFO:teuthology.kill:Killing Pids: {26107}
2021-02-07T10:36:04.722 INFO:teuthology.kill:Nuking machines: ['smithi086', 'smithi105']
2021-02-07T10:36:06.463 INFO:teuthology.kill:2021-02-07 10:36:06,463.463 INFO:teuthology.nuke:targets:
2021-02-07T10:36:06.467 INFO:teuthology.kill:  smithi086.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGiZN/y9CGcc3Jneu88uNsaID6goZS24vM1LsnnxBUOq4zNCeNIvnklulIiw2b1CQhSDUH1PV7aNj28wI0WCXLui8HPVZyLymA4o5Znj/KWHO/SSuiABHOa02AvpcGiWjHfolSpMJt9m1g3xPBaHmYU8FtxHFKZlbH4Sw5J2JBEU2FK6HF7lJagqbcyEFCkn1JK4G3FcpgrBlZ9sLmsek3uWCteT5vyQQ64IsJw/QNYiHw2AI4HbMKYu1ciLx71Ag0Em6J8/DqqPaJl6yB6YVzhDXYhXmxr9wkdsSCE+thYmzCkXLGJhRL7cuk5kJiWtG1wOQrf8tpTgaLqQn3Dw1SKloQRLO90lp6iYVx7+z48+MYmnI9to+Ch4+pL4AtlDyfLDBklgMQr5uN+Acrq6wMWTzgUnMA7DsssXbYAYrGa30JRzsyCgyzvtOAjH/OrJ2SoeI/7eOMPbvGXLxg2TUN4lytJwwzHHT/W5InV8UDlLH2bbpgGvWTcgYTqE+lDk=
2021-02-07T10:36:06.467 INFO:teuthology.kill:  smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaNow3/8YfpIg9BxLGbeKUe7szSWgzHpxS87/uydLgksHAbu/V1TTypXzSdkB+VAJQQ6FjkFNzB/S2PQeFIZSWeGFlEyGizxIbbfeJ5sujOi/rysOobSDfpW0QM/NgYuQfLNWzvMap/rEzDfTPNPU9MLV9acfJUc/+qe+i2Y1u/7Kakk97Z5LMORxDn24i7HR2KrRkBQtMnpX0QqFnzDBRtDpu90Q/G60Mq2UnlHu0yol8Pvlp6bAby4f7RIezLdJ/ntYX4dSioEcwY04Z8MOw2HkJajgp1fp1M9p4UuWWdIeaFLdAgrDlhRyh9yI732P3gpAk6FZ7JbKwW0xvUlorVTaRwXdN2Bg7tUX59krH7q5mbCXg3mFAwunnd9OstSr/1WeLXC+oZGRMzv3057NeHHoy5JXmdzpFojVHY3umt+lwTsd0m/X+PIQI4sPkKvXH9h46TgKaAa9gkvH2IBaAa+cDqRHxqaO7rz7PRpWEv5aWEjw5nHtzT4yZMFt+4JE=
2021-02-07T10:36:06.494 INFO:teuthology.kill:2021-02-07 10:36:06,494.494 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-07T10:36:06.498 INFO:teuthology.kill:2021-02-07 10:36:06,498.498 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-07T10:36:06.566 INFO:teuthology.kill:2021-02-07 10:36:06,566.566 INFO:teuthology.orchestra.console:Power off smithi086
2021-02-07T10:36:06.590 INFO:teuthology.kill:2021-02-07 10:36:06,589.589 INFO:teuthology.orchestra.console:Power off smithi105
2021-02-07T10:36:14.971 INFO:teuthology.kill:2021-02-07 10:36:14,971.971 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-02-07T10:36:14.980 INFO:teuthology.kill:2021-02-07 10:36:14,979.979 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2021-02-07T10:36:15.114 INFO:teuthology.kill:2021-02-07 10:36:15,113.113 INFO:teuthology.lock.ops:unlocked smithi105.front.sepia.ceph.com
2021-02-07T10:36:15.124 INFO:teuthology.kill:2021-02-07 10:36:15,124.124 INFO:teuthology.lock.ops:unlocked smithi086.front.sepia.ceph.com
2021-02-07T10:38:15.403 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-07T10:38:15.505 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-07T10:38:15.506 INFO:teuthology.nuke:Checking targets against current locks
2021-02-07T10:38:15.581 INFO:teuthology.nuke:Not nuking smithi105.front.sepia.ceph.com because description doesn't match
2021-02-07T10:38:15.581 INFO:teuthology.nuke:Not nuking smithi086.front.sepia.ceph.com because description doesn't match