2022-03-02T17:35:07.915 INFO:root:teuthology version: 1.1.0-cb5b1a75
2022-03-02T17:35:08.033 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging
2022-03-02T17:35:08.034 INFO:teuthology.lock.ops:Updating [ubuntu@smithi006.front.sepia.ceph.com]: reset os type and version on server
2022-03-02T17:35:08.034 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2022-03-02T17:35:08.052 INFO:teuthology.lock.ops:Node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging is complete
2022-03-02T17:35:08.053 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging
2022-03-02T17:35:08.053 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server
2022-03-02T17:35:08.053 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2022-03-02T17:35:08.072 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete
2022-03-02T17:35:08.289 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 8.stream
2022-03-02T17:35:08.294 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of centos 8.stream
2022-03-02T17:35:08.657 INFO:teuthology.orchestra.console:Power off smithi006
2022-03-02T17:35:08.672 INFO:teuthology.orchestra.console:Power off smithi082
2022-03-02T17:35:17.028 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2022-03-02T17:35:17.129 INFO:teuthology.orchestra.console:Power on smithi006
2022-03-02T17:35:21.145 INFO:teuthology.orchestra.console:Power off for smithi082 completed
2022-03-02T17:35:21.247 INFO:teuthology.orchestra.console:Power on smithi082
2022-03-02T17:35:25.496 INFO:teuthology.orchestra.console:Power on for smithi006 completed
2022-03-02T17:35:25.501 INFO:teuthology.orchestra.console:Power on for smithi082 completed
2022-03-02T17:35:25.598 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish
2022-03-02T17:35:25.602 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish
2022-03-02T17:39:37.878 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-02T17:39:42.370 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-02T17:39:42.650 INFO:teuthology.provision.fog.smithi006:Node is ready
2022-03-02T17:39:42.668 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com
2022-03-02T17:39:42.727 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006
2022-03-02T17:39:43.086 INFO:teuthology.provision.fog.smithi006:Deploy complete!
2022-03-02T17:40:02.771 INFO:teuthology.provision.fog.smithi082:Node is ready
2022-03-02T17:40:02.793 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com
2022-03-02T17:40:02.853 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082
2022-03-02T17:40:03.224 INFO:teuthology.provision.fog.smithi082:Deploy complete!
2022-03-02T17:40:03.371 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com
2022-03-02T17:40:03.372 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-02T17:40:03.391 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com
2022-03-02T17:40:03.392 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-02T17:40:03.409 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server
2022-03-02T17:40:03.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2022-03-02T17:40:03.658 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64
2022-03-02T17:40:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream"
2022-03-02T17:40:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8"
2022-03-02T17:40:03.717 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos"
2022-03-02T17:40:03.717 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora"
2022-03-02T17:40:03.717 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8"
2022-03-02T17:40:03.717 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2022-03-02T17:40:03.718 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-02T17:40:03.718 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2022-03-02T17:40:03.718 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-02T17:40:03.718 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/"
2022-03-02T17:40:03.719 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-02T17:40:03.719 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-02T17:40:03.719 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-02T17:40:03.721 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2022-03-02T17:40:03.740 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server
2022-03-02T17:40:03.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com'
2022-03-02T17:40:03.928 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64
2022-03-02T17:40:03.985 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream"
2022-03-02T17:40:03.985 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8"
2022-03-02T17:40:03.985 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos"
2022-03-02T17:40:03.985 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora"
2022-03-02T17:40:03.986 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8"
2022-03-02T17:40:03.986 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8"
2022-03-02T17:40:03.986 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-02T17:40:03.986 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31"
2022-03-02T17:40:03.986 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-02T17:40:03.987 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/"
2022-03-02T17:40:03.987 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-02T17:40:03.987 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-02T17:40:03.987 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-02T17:40:03.988 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2022-03-02T17:40:04.076 INFO:teuthology.dispatcher.supervisor:Running job 6716228
2022-03-02T17:40:04.076 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-02_15:57:25-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6716228 --name yuriw-2022-03-02_15:57:25-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-03-02_15:57:25-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6716228/orig.config.yaml
2022-03-02T17:40:04.080 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-02_15:57:25-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6716228
2022-03-02T17:40:04.080 INFO:teuthology.dispatcher.supervisor:Job PID: 15465
2022-03-02T17:40:04.081 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-03T00:10:32.494 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-03T00:10:32.822 INFO:teuthology.kill:Killing Pids: {15465}
2022-03-03T00:10:34.024 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-03T00:10:34.025 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-03T00:10:34.026 INFO:teuthology.misc:Compressing logs...
2022-03-03T00:10:34.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2022-03-03T00:10:34.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com'
2022-03-03T00:10:34.252 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-03T00:10:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-03T00:10:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-03T00:10:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now
2022-03-03T00:10:34.580 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-03T00:10:34.581 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now
2022-03-03T00:10:34.582 INFO:teuthology.misc:Compressing logs...
2022-03-03T00:10:35.018 INFO:teuthology.misc:Compressing logs...
2022-03-03T00:10:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-03T00:10:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-03T00:11:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-mon.smithi082.log: file size changed while zipping
2022-03-03T00:11:14.484 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-03T00:11:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-mgr.smithi006.lhfazy.log: file size changed while zipping
2022-03-03T00:11:30.383 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-mon.smithi006.log: file size changed while zipping
2022-03-03T00:11:30.512 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-03T00:11:50.324 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-03T00:11:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-03T00:12:10.778 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-03T00:12:22.439 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/ef60d2a4-9a50-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-03-03T00:13:03.115 INFO:teuthology.kill:No teuthology processes running
2022-03-03T00:13:04.319 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi082']
2022-03-03T00:13:05.343 INFO:teuthology.kill:2022-03-03 00:13:05,343.343 INFO:teuthology.nuke:targets:
2022-03-03T00:13:05.345 INFO:teuthology.kill:  smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCohige35fdLe7WeH3sZR51re1X9WOevP1k7lJB6BWIdix2GV2N5GIM3w4LH7EBoqrd0JDNUhD9fhVu7p8hzy0flg4YVZPp+PoH9pDvoXaVLGWIN83aA6TJf0fN7HqRQvZcPV04C31RFXGpir53qf3ksiBxcszYqmUF//7UJcxtwD2MHk1f24jVerGUjv3WmWQiGbKG/0AWsl3oVRlPFjCiM0axWJzjk2Pv5AICmt58FCdMYsD/W6LCmS57ftcbs/ltq6WhlLRxF7VBc7oFesIOlQZmLJuhM5XfdZdI1BaDEOafwXGQct3MqgBNSFB9HWJNKtDfxFPSueDGnG0D7EUKnINUuxGDYsMrVVhIWoOqyMftHwFUjJxTiiyVuPFwKX7sDVmb5P/aCUOMnumHo5FjVyWUC5dAjN191A9Ip3hRp0OeC/CoznaQmXlxL7Pzjbck9p6Pa2BvQr9EvffFM9x+5FN6N5Mr6yA8q4qQw4hKjzK2XGyNCUYJA8J9aUwRljM=
2022-03-03T00:13:05.345 INFO:teuthology.kill:  smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvrAWS4zKuf0MckZ5G/YkRFqVJUM6Aayx0GdsuaYhS4eALYgJyBhA6NZlFXvU5SfrccGGt6tN+G0OqOq8b29un1JUUGG/jQly0VbYEBxhoDTDGVFLZ2602NwEcOiNIihuLT4Z6lQ/fkjcf8jbs9lh4JpzytdaC+aynUt3CN96/9MmZ1Ye9cc9XrajcupB9AusMBm3eYrrebeNKWjAKgh02q+PJwgBgZ414hVOArBbo0h+29eg5KA3/t8QhdT3UsOtuc3dvyi8J6Rf2KhWbzQt3O6+v526vlPBoDVNHsopJq9eszHps1UON5TT8Q0n5MTX13QoRW16d4ogdVQqZSPyg1CtUPgFqyO89VnPZLt7Aw18cubA85m6bxEd+4W81VRzHGWVL+9umLl8pIBQsEDRTuWyZIg4oAdrKpEO0Fzw8QbgpKXWxcj3NihB0yOmZwOcN6S7YPs1Kp/LaO3DU1lcXdLLqC+ZYwdOvD+D5spoUkTFOEhgCLu3le+uF5/nGdEU=
2022-03-03T00:13:05.372 INFO:teuthology.kill:2022-03-03 00:13:05,371.371 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-03T00:13:05.412 INFO:teuthology.kill:2022-03-03 00:13:05,412.412 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-03T00:13:05.443 INFO:teuthology.kill:2022-03-03 00:13:05,443.443 INFO:teuthology.orchestra.console:Power off smithi082
2022-03-03T00:13:05.507 INFO:teuthology.kill:2022-03-03 00:13:05,507.507 INFO:teuthology.orchestra.console:Power off smithi006
2022-03-03T00:13:13.817 INFO:teuthology.kill:2022-03-03 00:13:13,816.816 INFO:teuthology.orchestra.console:Power off for smithi082 completed
2022-03-03T00:13:13.873 INFO:teuthology.kill:2022-03-03 00:13:13,873.873 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2022-03-03T00:13:13.960 INFO:teuthology.kill:2022-03-03 00:13:13,960.960 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com
2022-03-03T00:13:14.017 INFO:teuthology.kill:2022-03-03 00:13:14,016.016 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com
2022-03-03T00:15:14.335 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-03T00:15:14.435 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi006 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-02_21:56:05-rados-wip-yuri11-testing-2022-03-02-0820-octopus-distro-default-smithi/6716859
2022-03-03T00:15:14.435 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi082 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-02_21:56:05-rados-wip-yuri11-testing-2022-03-02-0820-octopus-distro-default-smithi/6716859