2021-12-03T05:07:53.355 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-03T05:07:53.486 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi019.front.sepia.ceph.com' reimaging
2021-12-03T05:07:53.488 INFO:teuthology.lock.ops:Updating [ubuntu@smithi019.front.sepia.ceph.com]: reset os type and version on server
2021-12-03T05:07:53.488 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2021-12-03T05:07:53.509 INFO:teuthology.lock.ops:Node 'ubuntu@smithi019.front.sepia.ceph.com' reimaging is complete
2021-12-03T05:07:53.509 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi186.front.sepia.ceph.com' reimaging
2021-12-03T05:07:53.510 INFO:teuthology.lock.ops:Updating [ubuntu@smithi186.front.sepia.ceph.com]: reset os type and version on server
2021-12-03T05:07:53.510 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2021-12-03T05:07:53.527 INFO:teuthology.lock.ops:Node 'ubuntu@smithi186.front.sepia.ceph.com' reimaging is complete
2021-12-03T05:07:53.740 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream
2021-12-03T05:07:53.744 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 8.stream
2021-12-03T05:07:54.204 INFO:teuthology.orchestra.console:Power off smithi019
2021-12-03T05:07:54.218 INFO:teuthology.orchestra.console:Power off smithi186
2021-12-03T05:08:02.576 INFO:teuthology.orchestra.console:Power off for smithi019 completed
2021-12-03T05:08:02.678 INFO:teuthology.orchestra.console:Power on smithi019
2021-12-03T05:08:06.694 INFO:teuthology.orchestra.console:Power off for smithi186 completed
2021-12-03T05:08:06.796 INFO:teuthology.orchestra.console:Power on smithi186
2021-12-03T05:08:11.043 INFO:teuthology.orchestra.console:Power on for smithi019 completed
2021-12-03T05:08:11.049 INFO:teuthology.orchestra.console:Power on for smithi186 completed
2021-12-03T05:08:11.146 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2021-12-03T05:08:11.152 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2021-12-03T05:12:45.993 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-03T05:12:46.281 INFO:teuthology.provision.fog.smithi019:Node is ready
2021-12-03T05:12:46.300 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com
2021-12-03T05:12:46.359 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019
2021-12-03T05:12:46.722 INFO:teuthology.provision.fog.smithi019:Deploy complete!
2021-12-03T05:13:16.177 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-03T05:13:16.473 INFO:teuthology.provision.fog.smithi186:Node is ready
2021-12-03T05:13:16.493 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com
2021-12-03T05:13:16.554 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2021-12-03T05:13:16.916 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2021-12-03T05:13:17.093 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com
2021-12-03T05:13:17.093 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-03T05:13:17.164 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com
2021-12-03T05:13:17.165 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-03T05:13:17.195 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server
2021-12-03T05:13:17.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2021-12-03T05:13:17.485 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64
2021-12-03T05:13:17.543 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2021-12-03T05:13:17.544 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8"
2021-12-03T05:13:17.544 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2021-12-03T05:13:17.544 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2021-12-03T05:13:17.545 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8"
2021-12-03T05:13:17.545 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8"
2021-12-03T05:13:17.545 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-03T05:13:17.545 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2021-12-03T05:13:17.546 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-03T05:13:17.546 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2021-12-03T05:13:17.546 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-03T05:13:17.546 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-03T05:13:17.547 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-03T05:13:17.548 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2021-12-03T05:13:17.577 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server
2021-12-03T05:13:17.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2021-12-03T05:13:17.779 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64
2021-12-03T05:13:17.838 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream"
2021-12-03T05:13:17.838 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8"
2021-12-03T05:13:17.838 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos"
2021-12-03T05:13:17.839 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora"
2021-12-03T05:13:17.839 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8"
2021-12-03T05:13:17.839 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2021-12-03T05:13:17.839 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-03T05:13:17.839 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2021-12-03T05:13:17.840 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-03T05:13:17.840 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/"
2021-12-03T05:13:17.840 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-03T05:13:17.840 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-03T05:13:17.841 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-03T05:13:17.841 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2021-12-03T05:13:17.981 INFO:teuthology.dispatcher.supervisor:Running job 6540785
2021-12-03T05:13:17.982 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-02_20:31:36-rados-wip-yuri5-testing-2021-12-01-0841-distro-default-smithi/6540785 --name yuriw-2021-12-02_20:31:36-rados-wip-yuri5-testing-2021-12-01-0841-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2021-12-02_20:31:36-rados-wip-yuri5-testing-2021-12-01-0841-distro-default-smithi/6540785/orig.config.yaml
2021-12-03T05:13:17.987 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-02_20:31:36-rados-wip-yuri5-testing-2021-12-01-0841-distro-default-smithi/6540785
2021-12-03T05:13:17.988 INFO:teuthology.dispatcher.supervisor:Job PID: 13643
2021-12-03T05:13:17.988 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-03T17:13:38.473 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-03T17:13:39.131 INFO:teuthology.kill:Killing Pids: {13643}
2021-12-03T17:13:40.282 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-03T17:13:40.283 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-03T17:13:40.283 INFO:teuthology.misc:Compressing logs...
2021-12-03T17:13:40.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2021-12-03T17:13:40.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2021-12-03T17:13:40.534 INFO:teuthology.orchestra.run.smithi019.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-03T17:13:40.719 INFO:teuthology.orchestra.run.smithi186.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-03T17:13:40.761 INFO:teuthology.orchestra.run.smithi019.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-03T17:13:40.762 INFO:teuthology.orchestra.run.smithi019.stderr:tar: Error is not recoverable: exiting now
2021-12-03T17:13:40.800 INFO:teuthology.orchestra.run.smithi186.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-03T17:13:40.800 INFO:teuthology.orchestra.run.smithi186.stderr:tar: Error is not recoverable: exiting now
2021-12-03T17:13:40.802 INFO:teuthology.misc:Compressing logs...
2021-12-03T17:13:41.191 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-03T17:13:41.394 INFO:teuthology.misc:Compressing logs...
2021-12-03T17:14:02.795 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-mon.smithi019.log: file size changed while zipping
2021-12-03T17:14:10.765 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-03T17:14:30.342 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-03T17:14:35.403 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-03T17:14:56.039 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-03T17:15:00.509 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-03T17:15:13.974 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-03T17:15:22.195 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-03T17:15:32.291 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-mon.smithi186.log: file size changed while zipping
2021-12-03T17:15:40.107 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-mgr.smithi186.vqzzhl.log: file size changed while zipping
2021-12-03T17:15:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/285dfdd8-53f8-11ec-8c2e-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-03T17:16:30.167 INFO:teuthology.kill:No teuthology processes running
2021-12-03T17:16:31.348 INFO:teuthology.kill:Nuking machines: ['smithi019', 'smithi186']
2021-12-03T17:16:32.319 INFO:teuthology.kill:2021-12-03 17:16:32,319.319 INFO:teuthology.nuke:targets:
2021-12-03T17:16:32.320 INFO:teuthology.kill:  smithi019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCXrjkk6zsgD/br6B86Ir6qOuvRRWKkGPbgxOloBPVSqM+gg6RtB9AndotXJkL9gtijiS6AdBq689AsZQ3bfyV1FNadkuDrV4kIMvspWMR/wMM5rVr9x3pS8ZgmvmcLfXz6is4kyvveS78qVVyqAQMLS0qdwyL0O8PdGhjdS9F6Zb6yw+LIN5kXubIDpZHAe1ryMK51BYd/hTsRDYxEbJoN5ZwLK33U+j5Nvqp5JBDRZrpAC1HmVMXRFeKxUCp1FyVINuy1aMo0WRhHE3UU6yLuXeoLPRNwb5ngKcxLPx0NP0pZop4dHvPS2r3oTt0z0LVfNQDfQU/JuPcCazu1N1VVC48VfrI6jI5KmJVYl38zIMKC4iY3qoUL8SzDaR+6JXfU8swxrqeMg/iU2vgnULGuT7k5to0pC7VThH7ulWBEqyX+N3MAxgPahAb5X9C5mDsLqBnve6FDMMtnZ8m4HmzY8jxseyHO8ZIBm12xueMywqofckw+2PTcJzIZfUpkoc=
2021-12-03T17:16:32.320 INFO:teuthology.kill:  smithi186.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyw7pWSEBkJaDlUw51+g7mYhyZW5OXxA179Rndk2wQYjqzQw4cVaaKV5jqNtcirO/CA8GzOHIHrl4ElcPGSv9onxl0RJhRKmUG4lN14b4kB1PoTvKZfVUtw10Sva/GkP0Czj/i3LoSofRIOUVw4FpTkkXexQZmFwiVZu9ywMNeEK/UBQ233AGfwEoHL0N8jrogWBCs2WIujmziEtX+53r5qxNrI0RQdJphvmUI4B13y+Av5dmnIPuD5jcx9vFQ7qBxarrqJiyir0AIjMVyiJ0ZiBuUAhk+s/Qz4h4fvepe0MEsFOQ1egHfq5G3iBDC9Il03n14x1piNpHr6t2ng92IFxOdnel4ySkq+jsjHmCXKp63bGRA3uVOjlY6CXaZAH1lTUb0FbnxUNSq1luo16vIiimBXmh5Nk7wmEZ9L36If/AWVu89q+5n38PCH5SClqurLXWC2hf+MRIeEmE/wS9Hg5M3E0WVaSZGwtbUH0iKwF81D+7TPGoOGOKti1TM7mU=
2021-12-03T17:16:32.348 INFO:teuthology.kill:2021-12-03 17:16:32,347.347 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-03T17:16:32.351 INFO:teuthology.kill:2021-12-03 17:16:32,351.351 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-03T17:16:32.424 INFO:teuthology.kill:2021-12-03 17:16:32,423.423 INFO:teuthology.orchestra.console:Power off smithi019
2021-12-03T17:16:32.443 INFO:teuthology.kill:2021-12-03 17:16:32,442.442 INFO:teuthology.orchestra.console:Power off smithi186
2021-12-03T17:16:40.801 INFO:teuthology.kill:2021-12-03 17:16:40,801.801 INFO:teuthology.orchestra.console:Power off for smithi019 completed
2021-12-03T17:16:40.949 INFO:teuthology.kill:2021-12-03 17:16:40,948.948 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com
2021-12-03T17:16:44.922 INFO:teuthology.kill:2021-12-03 17:16:44,921.921 INFO:teuthology.orchestra.console:Power off for smithi186 completed
2021-12-03T17:16:45.071 INFO:teuthology.kill:2021-12-03 17:16:45,071.071 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com
2021-12-03T17:18:45.388 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-03T17:18:45.491 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi019 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-03_15:27:18-rados-wip-yuri11-testing-2021-12-02-1451-distro-default-smithi/6542724
2021-12-03T17:18:45.491 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi186 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-03_15:27:18-rados-wip-yuri11-testing-2021-12-02-1451-distro-default-smithi/6542724