2022-01-12T17:29:22.203 INFO:root:teuthology version: 1.1.0-00e09f05
2022-01-12T17:29:22.319 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi001.front.sepia.ceph.com' reimaging
2022-01-12T17:29:22.320 INFO:teuthology.lock.ops:Updating [ubuntu@smithi001.front.sepia.ceph.com]: reset os type and version on server
2022-01-12T17:29:22.320 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2022-01-12T17:29:22.339 INFO:teuthology.lock.ops:Node 'ubuntu@smithi001.front.sepia.ceph.com' reimaging is complete
2022-01-12T17:29:22.339 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi018.front.sepia.ceph.com' reimaging
2022-01-12T17:29:22.339 INFO:teuthology.lock.ops:Updating [ubuntu@smithi018.front.sepia.ceph.com]: reset os type and version on server
2022-01-12T17:29:22.340 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2022-01-12T17:29:22.357 INFO:teuthology.lock.ops:Node 'ubuntu@smithi018.front.sepia.ceph.com' reimaging is complete
2022-01-12T17:29:22.546 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of centos 8.stream
2022-01-12T17:29:22.566 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 8.stream
2022-01-12T17:29:22.926 INFO:teuthology.orchestra.console:Power off smithi001
2022-01-12T17:29:22.939 INFO:teuthology.orchestra.console:Power off smithi018
2022-01-12T17:29:31.301 INFO:teuthology.orchestra.console:Power off for smithi001 completed
2022-01-12T17:29:31.305 INFO:teuthology.orchestra.console:Power off for smithi018 completed
2022-01-12T17:29:31.402 INFO:teuthology.orchestra.console:Power on smithi001
2022-01-12T17:29:31.413 INFO:teuthology.orchestra.console:Power on smithi018
2022-01-12T17:29:39.775 INFO:teuthology.orchestra.console:Power on for smithi001 completed
2022-01-12T17:29:39.780 INFO:teuthology.orchestra.console:Power on for smithi018 completed
2022-01-12T17:29:39.877 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish
2022-01-12T17:29:39.881 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish
2022-01-12T17:34:14.431 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-12T17:34:14.462 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-12T17:34:14.754 INFO:teuthology.provision.fog.smithi001:Node is ready
2022-01-12T17:34:14.772 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com
2022-01-12T17:34:14.776 INFO:teuthology.provision.fog.smithi018:Node is ready
2022-01-12T17:34:14.793 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com
2022-01-12T17:34:14.829 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001
2022-01-12T17:34:14.852 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018
2022-01-12T17:34:15.175 INFO:teuthology.provision.fog.smithi001:Deploy complete!
2022-01-12T17:34:15.199 INFO:teuthology.provision.fog.smithi018:Deploy complete!
2022-01-12T17:34:15.351 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com
2022-01-12T17:34:15.352 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-12T17:34:15.373 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com
2022-01-12T17:34:15.373 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-12T17:34:15.392 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server
2022-01-12T17:34:15.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2022-01-12T17:34:15.584 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64
2022-01-12T17:34:15.641 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream"
2022-01-12T17:34:15.642 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8"
2022-01-12T17:34:15.642 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos"
2022-01-12T17:34:15.642 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora"
2022-01-12T17:34:15.642 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8"
2022-01-12T17:34:15.643 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8"
2022-01-12T17:34:15.643 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-12T17:34:15.643 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2022-01-12T17:34:15.643 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-12T17:34:15.644 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/"
2022-01-12T17:34:15.644 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-12T17:34:15.644 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-12T17:34:15.644 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-12T17:34:15.646 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2022-01-12T17:34:15.664 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server
2022-01-12T17:34:15.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com'
2022-01-12T17:34:15.860 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64
2022-01-12T17:34:15.919 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream"
2022-01-12T17:34:15.919 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8"
2022-01-12T17:34:15.920 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2022-01-12T17:34:15.920 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2022-01-12T17:34:15.920 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8"
2022-01-12T17:34:15.920 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8"
2022-01-12T17:34:15.920 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-12T17:34:15.921 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2022-01-12T17:34:15.921 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-12T17:34:15.921 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2022-01-12T17:34:15.921 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-12T17:34:15.922 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-12T17:34:15.922 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-12T17:34:15.922 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2022-01-12T17:34:16.015 INFO:teuthology.dispatcher.supervisor:Running job 6610417
2022-01-12T17:34:16.015 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-12_15:28:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi/6610417 --name yuriw-2022-01-12_15:28:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-01-12_15:28:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi/6610417/orig.config.yaml
2022-01-12T17:34:16.018 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-12_15:28:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi/6610417
2022-01-12T17:34:16.019 INFO:teuthology.dispatcher.supervisor:Job PID: 5361
2022-01-12T17:34:16.019 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-13T05:35:10.115 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-13T05:35:10.304 INFO:teuthology.kill:Killing Pids: {5361}
2022-01-13T05:35:11.505 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-13T05:35:11.506 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-13T05:35:11.506 INFO:teuthology.misc:Compressing logs...
2022-01-13T05:35:11.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2022-01-13T05:35:11.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com'
2022-01-13T05:35:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-13T05:35:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-13T05:35:12.012 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-13T05:35:12.012 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now
2022-01-13T05:35:12.051 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-13T05:35:12.052 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now
2022-01-13T05:35:12.053 INFO:teuthology.misc:Compressing logs...
2022-01-13T05:35:12.385 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-13T05:35:12.465 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-13T05:35:12.682 INFO:teuthology.misc:Compressing logs...
2022-01-13T05:35:15.927 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-13T05:35:17.438 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-13T05:35:18.696 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-13T05:35:21.907 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-13T05:35:21.986 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-mon.smithi001.log: file size changed while zipping
2022-01-13T05:35:24.523 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-13T05:35:25.492 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-mon.smithi018.log: file size changed while zipping
2022-01-13T05:35:25.560 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-13T05:35:28.515 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-13T05:35:30.426 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-mgr.smithi001.aofblz.log: file size changed while zipping
2022-01-13T05:35:35.133 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/0e467424-73cf-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-13T05:36:27.918 INFO:teuthology.kill:No teuthology processes running
2022-01-13T05:36:29.046 INFO:teuthology.kill:Nuking machines: ['smithi001', 'smithi018']
2022-01-13T05:36:29.964 INFO:teuthology.kill:2022-01-13 05:36:29,964.964 INFO:teuthology.nuke:targets:
2022-01-13T05:36:29.965 INFO:teuthology.kill:  smithi001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDpaAvVK+XP6e79HP4RBehp+850fQ6PTui2sk3URhZ4JUTdMCT1R9Lz1tL1dN3i7x5EDQjMZSFyZE2EaH9J+p5qykM//h9mnQf0bvWFV1miGAY6MXtTY9ft2TDRgvD2TfYqSYWDM9HxMaI123ulSmAwL+YewAUSPKndeFVisURqYdWcaZHLoH39Ng6oiD7jSHF9hchjNkLqavc18888WaM67WNoHHPNXMewzLkXNue51Z4Z7nuvbczpY7xPuBt9sDkGsGIrXLu8NN1seohJMFce1Ea4BBnkvA6Oc84um9NMZUp+JG2K29tN8SS1bomp5vDJM6/NQMXCury2GYYCLihqsRsJuSUlo1t0hKP0ikC7dgUpPEEqg7E3iQvDDZ+uEOUv5Nlsy2twWTGFsZISjZgNoXgLpfRf2yqerxVqE+ABMlHeMWwNIhm9RwP34su/hGncLSuoylUwEWFkgtmtDeIvPXhKQLeOtELuJ39IphPKYfWR1We9NZNmW7mbjTJblTU=
2022-01-13T05:36:29.965 INFO:teuthology.kill:  smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDf6burQwrwc2FWaWY4AOp/x1jkeNLFpTMI9iEvfXLxlEuBgvk56R+SYzn7Q+zbfAtiYtluAJwF4h3dfL4vBi9dN7IZSDX0v9PBPyBqcseGfyOTh9QcmNiNiXouxn2EIPTsyJGSb8KfCz0t8rbI+dbOgFIM3paD5jlIct/SlFi3APRvCGs3DfJIXHEJY3DsVnIbEJ8XPly7Yz3+fB0oFYynRyFHb6ZQ62svSJ3nkQAZsXIe7DX/ccwI0XkznTzheEP7gREeBSjcnLwEpMkWPjNo3DijPft6AuBHIohxBogAayK/vWC4+WunLXZG/uHpZuVBFsb7l8vcBcTr//YwijGmopOHmxY3ClMhyJ1mTytLJ8LgICQSwGhRQZbbIQUFcyBwkQ5Jf5Fa0dDfrnt1vjCKYm384ZJ0f9hR2qTqN5GNQH5wJLHBPi3lIIU9FCEF/P3lUTj3g9/JEOkKwgviOReuZ4bMRvBYvSM78Vq2dk4UJp4AheOUG1mxiyf3AltFC3U=
2022-01-13T05:36:29.991 INFO:teuthology.kill:2022-01-13 05:36:29,991.991 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-13T05:36:29.994 INFO:teuthology.kill:2022-01-13 05:36:29,994.994 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-13T05:36:30.071 INFO:teuthology.kill:2022-01-13 05:36:30,070.070 INFO:teuthology.orchestra.console:Power off smithi018
2022-01-13T05:36:30.083 INFO:teuthology.kill:2022-01-13 05:36:30,082.082 INFO:teuthology.orchestra.console:Power off smithi001
2022-01-13T05:36:38.441 INFO:teuthology.kill:2022-01-13 05:36:38,441.441 INFO:teuthology.orchestra.console:Power off for smithi018 completed
2022-01-13T05:36:38.446 INFO:teuthology.kill:2022-01-13 05:36:38,446.446 INFO:teuthology.orchestra.console:Power off for smithi001 completed
2022-01-13T05:36:38.596 INFO:teuthology.kill:2022-01-13 05:36:38,596.596 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com
2022-01-13T05:36:38.600 INFO:teuthology.kill:2022-01-13 05:36:38,600.600 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com
2022-01-13T05:38:38.955 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-13T05:38:39.085 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi001 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-01-13_04:42:40-fs-wip-vshankar-testing-20220106-145819-testing-default-smithi/6612013
2022-01-13T05:38:39.085 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi018 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-01-13_04:42:40-fs-wip-vshankar-testing-20220106-145819-testing-default-smithi/6612013