2022-03-24T07:42:05.173 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-24T07:42:05.299 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging
2022-03-24T07:42:05.300 INFO:teuthology.lock.ops:Updating [ubuntu@smithi078.front.sepia.ceph.com]: reset os type and version on server
2022-03-24T07:42:05.300 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2022-03-24T07:42:05.320 INFO:teuthology.lock.ops:Node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging is complete
2022-03-24T07:42:05.320 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi138.front.sepia.ceph.com' reimaging
2022-03-24T07:42:05.320 INFO:teuthology.lock.ops:Updating [ubuntu@smithi138.front.sepia.ceph.com]: reset os type and version on server
2022-03-24T07:42:05.321 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2022-03-24T07:42:05.338 INFO:teuthology.lock.ops:Node 'ubuntu@smithi138.front.sepia.ceph.com' reimaging is complete
2022-03-24T07:42:05.558 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 8.stream
2022-03-24T07:42:05.562 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.stream
2022-03-24T07:42:05.950 INFO:teuthology.orchestra.console:Power off smithi138
2022-03-24T07:42:05.990 INFO:teuthology.orchestra.console:Power off smithi078
2022-03-24T07:42:14.354 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2022-03-24T07:42:14.456 INFO:teuthology.orchestra.console:Power on smithi078
2022-03-24T07:42:18.445 INFO:teuthology.orchestra.console:Power off for smithi138 completed
2022-03-24T07:42:18.547 INFO:teuthology.orchestra.console:Power on smithi138
2022-03-24T07:42:22.822 INFO:teuthology.orchestra.console:Power on for smithi078 completed
2022-03-24T07:42:22.923 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2022-03-24T07:42:26.913 INFO:teuthology.orchestra.console:Power on for smithi138 completed
2022-03-24T07:42:27.014 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish
2022-03-24T07:46:31.844 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-24T07:46:57.203 INFO:teuthology.provision.fog.smithi078:Node is ready
2022-03-24T07:46:57.267 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2022-03-24T07:46:57.327 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2022-03-24T07:46:57.740 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2022-03-24T07:47:05.244 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-24T07:47:05.493 INFO:teuthology.provision.fog.smithi138:Node is ready
2022-03-24T07:47:05.511 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com
2022-03-24T07:47:05.569 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138
2022-03-24T07:47:05.906 INFO:teuthology.provision.fog.smithi138:Deploy complete!
2022-03-24T07:47:06.058 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2022-03-24T07:47:06.059 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-24T07:47:06.078 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com
2022-03-24T07:47:06.078 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-24T07:47:06.096 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2022-03-24T07:47:06.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2022-03-24T07:47:06.298 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2022-03-24T07:47:06.358 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2022-03-24T07:47:06.359 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8"
2022-03-24T07:47:06.359 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2022-03-24T07:47:06.359 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2022-03-24T07:47:06.359 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8"
2022-03-24T07:47:06.360 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2022-03-24T07:47:06.360 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-24T07:47:06.360 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2022-03-24T07:47:06.360 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-24T07:47:06.361 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2022-03-24T07:47:06.361 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-24T07:47:06.361 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-24T07:47:06.361 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-24T07:47:06.362 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2022-03-24T07:47:06.381 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server
2022-03-24T07:47:06.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2022-03-24T07:47:06.567 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2022-03-24T07:47:06.624 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream"
2022-03-24T07:47:06.624 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8"
2022-03-24T07:47:06.625 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos"
2022-03-24T07:47:06.625 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora"
2022-03-24T07:47:06.627 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8"
2022-03-24T07:47:06.627 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2022-03-24T07:47:06.628 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-24T07:47:06.628 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2022-03-24T07:47:06.628 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-24T07:47:06.628 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/"
2022-03-24T07:47:06.629 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-24T07:47:06.629 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-24T07:47:06.629 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-24T07:47:06.630 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2022-03-24T07:47:06.725 INFO:teuthology.dispatcher.supervisor:Running job 6755674
2022-03-24T07:47:06.726 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-23_14:03:22-orch-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/6755674 --name yuriw-2022-03-23_14:03:22-orch-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi --description orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-03-23_14:03:22-orch-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/6755674/orig.config.yaml
2022-03-24T07:47:06.729 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-23_14:03:22-orch-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/6755674
2022-03-24T07:47:06.730 INFO:teuthology.dispatcher.supervisor:Job PID: 16851
2022-03-24T07:47:06.731 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-24T14:17:36.289 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-24T14:17:36.491 INFO:teuthology.kill:Killing Pids: {16851}
2022-03-24T14:17:37.682 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-24T14:17:37.683 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-24T14:17:37.683 INFO:teuthology.misc:Compressing logs...
2022-03-24T14:17:37.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2022-03-24T14:17:37.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2022-03-24T14:17:37.930 INFO:teuthology.orchestra.run.smithi078.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-24T14:17:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-24T14:17:38.165 INFO:teuthology.orchestra.run.smithi078.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-24T14:17:38.165 INFO:teuthology.orchestra.run.smithi078.stderr:tar: Error is not recoverable: exiting now
2022-03-24T14:17:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-24T14:17:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:tar: Error is not recoverable: exiting now
2022-03-24T14:17:38.216 INFO:teuthology.misc:Compressing logs...
2022-03-24T14:17:38.444 INFO:teuthology.misc:Compressing logs...
2022-03-24T14:17:40.832 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-mgr.smithi078.tlqzyu.log: file size changed while zipping
2022-03-24T14:17:42.206 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-mon.smithi138.log: file size changed while zipping
2022-03-24T14:17:55.834 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-24T14:17:59.064 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-24T14:18:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-24T14:18:17.965 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-mon.smithi078.log: file size changed while zipping
2022-03-24T14:18:18.582 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-24T14:18:32.549 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-24T14:18:32.638 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-mgr.smithi138.lxdapm.log: file size changed while zipping
2022-03-24T14:18:35.734 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-24T14:18:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-24T14:18:52.401 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/d9879988-ab47-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-03-24T14:19:08.342 INFO:teuthology.orchestra.run.smithi078.stderr:tar: .: file changed as we read it
2022-03-24T14:19:22.442 INFO:teuthology.kill:No teuthology processes running
2022-03-24T14:19:23.594 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi138']
2022-03-24T14:19:24.572 INFO:teuthology.kill:2022-03-24 14:19:24,571.571 INFO:teuthology.nuke:targets:
2022-03-24T14:19:24.573 INFO:teuthology.kill:  smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJG235pWAGjTM6nPmXouhIknkRd/aGCHfwifRhcrRP96xD+wcDv+9NC+OtZdQofUkLD+uHrpnlLXJd051b0DyfPNb4XHdJiBCnHfEGB16iSsvdcIYHvqVY3mzQUPmMlbR41QjZM8TrZTwJzQ4iJ4ERRMIxbkiVChjzCZ5con4Fcm4MuKsHN4Mn5RMVab0CKGzBH3Yepd7VVO3rETOdB0M0ezu9RO++q0adkyemadIlb+5gBcvVbLwklJiHN7zwJQlD3wTN4AU1Z/22h/lEx8t0IxJ5/hTGiywq9yYHA8BU6DzJTHjSIQaDRzH5Tm+dTknC//MaEiOP1OhDdXoRZm0QQkjVZLZNP2JuqoEARaXQgIVXUHb+nEHhpVCUXCSj8l0axGfJBig5/4MG9AsiHiePkVW9sJBkCZvy9Ea1wrDp+SWO4voaW0al75I2z5izl3UaNWw2J6pWKdY0x9dIdqkn2B6i1TMymZuUQQevikmauUbNJxQg4cLxlr568gXhpNU=
2022-03-24T14:19:24.574 INFO:teuthology.kill:  smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPdLKmvlTo/iRaknjzehXNTUymx70Wt83c3uvCGLOpdBDeO/DC4m0jto3Eg6oQ7AarnqPH/HKMJ+xTzhozys8X85smZb8yWXVKUviso6fjpB05UPCOuIC0vGTrOLoVQdwwwsrTmEAC9n+osL34G5LM8uBmzA6cPDlg6mIJ0/i3wQhvoawEdzFSio6ky/DFrIbSvTofhKDRKdf4tlHU2Ca4UhsyB/OWOXeI4SQEISgdsHApQUvgs3rQ2Ej4hAaDFPj4/bpV0jHwhVr/tBWRKeA6C76cwtJKf7lI3GRNJbj123gBNM3LAWR5hhj03NdBR+eQZd4TVPFFyBI0r4N+FSHjUXx8UcsTGQ7dx/it/PiZfziE8wzIFRhqa42YW0btSz6I+Ot1YjLnWZxSHNpJtcEhS41MOjJafLgT2ESWZnF6RoSkZ5pyaPo5aM4wHt1+Qx6Qnk7iF9kdfmfXGhlrgdKnxIThZ/Gy7RIMuXZlZ0ym7Vc+w5MDnOhoru/RCIctNPs=
2022-03-24T14:19:24.598 INFO:teuthology.kill:2022-03-24 14:19:24,597.597 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-24T14:19:24.601 INFO:teuthology.kill:2022-03-24 14:19:24,601.601 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-24T14:19:24.675 INFO:teuthology.kill:2022-03-24 14:19:24,675.675 INFO:teuthology.orchestra.console:Power off smithi138
2022-03-24T14:19:24.688 INFO:teuthology.kill:2022-03-24 14:19:24,687.687 INFO:teuthology.orchestra.console:Power off smithi078
2022-03-24T14:19:33.051 INFO:teuthology.kill:2022-03-24 14:19:33,051.051 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2022-03-24T14:19:33.200 INFO:teuthology.kill:2022-03-24 14:19:33,199.199 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com
2022-03-24T14:19:37.160 INFO:teuthology.kill:2022-03-24 14:19:37,160.160 INFO:teuthology.orchestra.console:Power off for smithi138 completed
2022-03-24T14:19:37.311 INFO:teuthology.kill:2022-03-24 14:19:37,310.310 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com
2022-03-24T14:21:37.618 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-24T14:21:37.717 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi078 but it was locked by another job: /home/teuthworker/archive/kchai-2022-03-23_11:17:34-rados-wip-cxx20-fixes-mon-1-distro-default-smithi/6755199
2022-03-24T14:21:37.718 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi138 but it was locked by another job: /home/teuthworker/archive/kchai-2022-03-23_11:17:34-rados-wip-cxx20-fixes-mon-1-distro-default-smithi/6755199