2022-02-24T06:06:37.800 INFO:root:teuthology version: 1.1.0-6b607b46
2022-02-24T06:06:37.916 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi133.front.sepia.ceph.com' reimaging
2022-02-24T06:06:37.917 INFO:teuthology.lock.ops:Updating [ubuntu@smithi133.front.sepia.ceph.com]: reset os type and version on server
2022-02-24T06:06:37.918 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2022-02-24T06:06:37.935 INFO:teuthology.lock.ops:Node 'ubuntu@smithi133.front.sepia.ceph.com' reimaging is complete
2022-02-24T06:06:37.935 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging
2022-02-24T06:06:37.936 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server
2022-02-24T06:06:37.936 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-02-24T06:06:37.956 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete
2022-02-24T06:06:38.184 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream
2022-02-24T06:06:38.195 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream
2022-02-24T06:06:38.674 INFO:teuthology.orchestra.console:Power off smithi133
2022-02-24T06:06:38.828 INFO:teuthology.orchestra.console:Power off smithi142
2022-02-24T06:06:47.192 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-02-24T06:06:47.293 INFO:teuthology.orchestra.console:Power on smithi142
2022-02-24T06:06:51.156 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2022-02-24T06:06:51.257 INFO:teuthology.orchestra.console:Power on smithi133
2022-02-24T06:06:55.511 INFO:teuthology.orchestra.console:Power on for smithi133 completed
2022-02-24T06:06:55.613 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2022-02-24T06:06:55.660 INFO:teuthology.orchestra.console:Power on for smithi142 completed
2022-02-24T06:06:55.761 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2022-02-24T06:11:02.306 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-24T06:11:02.466 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-24T06:11:27.331 INFO:teuthology.provision.fog.smithi142:Node is ready
2022-02-24T06:11:27.355 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2022-02-24T06:11:27.414 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2022-02-24T06:11:27.791 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2022-02-24T06:11:28.112 INFO:teuthology.provision.fog.smithi133:Node is ready
2022-02-24T06:11:28.135 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com
2022-02-24T06:11:28.193 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2022-02-24T06:11:28.567 INFO:teuthology.provision.fog.smithi133:Deploy complete!
2022-02-24T06:11:28.713 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com
2022-02-24T06:11:28.714 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-24T06:11:28.760 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2022-02-24T06:11:28.760 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-24T06:11:28.790 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server
2022-02-24T06:11:28.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2022-02-24T06:11:28.988 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64
2022-02-24T06:11:29.043 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream"
2022-02-24T06:11:29.044 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8"
2022-02-24T06:11:29.044 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos"
2022-02-24T06:11:29.044 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora"
2022-02-24T06:11:29.045 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8"
2022-02-24T06:11:29.045 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8"
2022-02-24T06:11:29.045 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-24T06:11:29.045 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31"
2022-02-24T06:11:29.046 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-24T06:11:29.046 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/"
2022-02-24T06:11:29.046 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-24T06:11:29.046 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-24T06:11:29.047 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-24T06:11:29.048 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2022-02-24T06:11:29.066 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2022-02-24T06:11:29.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-02-24T06:11:29.317 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2022-02-24T06:11:29.384 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2022-02-24T06:11:29.384 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8"
2022-02-24T06:11:29.384 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2022-02-24T06:11:29.384 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2022-02-24T06:11:29.385 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8"
2022-02-24T06:11:29.385 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2022-02-24T06:11:29.385 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-24T06:11:29.385 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2022-02-24T06:11:29.386 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-24T06:11:29.386 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2022-02-24T06:11:29.386 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-24T06:11:29.386 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-24T06:11:29.386 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-24T06:11:29.387 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-02-24T06:11:29.487 INFO:teuthology.dispatcher.supervisor:Running job 6703730
2022-02-24T06:11:29.487 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b607b46862a6b148fb1608e09b31d367f094555/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-02-24_02:51:26-orch:cephadm-wip-adk-testing-2022-02-23-1713-distro-basic-smithi/6703730 --name adking-2022-02-24_02:51:26-orch:cephadm-wip-adk-testing-2022-02-23-1713-distro-basic-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2022-02-24_02:51:26-orch:cephadm-wip-adk-testing-2022-02-23-1713-distro-basic-smithi/6703730/orig.config.yaml
2022-02-24T06:11:29.491 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-02-24_02:51:26-orch:cephadm-wip-adk-testing-2022-02-23-1713-distro-basic-smithi/6703730
2022-02-24T06:11:29.492 INFO:teuthology.dispatcher.supervisor:Job PID: 19508
2022-02-24T06:11:29.493 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-24T12:41:58.649 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-24T12:41:58.827 INFO:teuthology.kill:Killing Pids: {19508}
2022-02-24T12:42:00.102 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-02-24T12:42:00.103 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-02-24T12:42:00.104 INFO:teuthology.misc:Compressing logs...
2022-02-24T12:42:00.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2022-02-24T12:42:00.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-02-24T12:42:00.319 INFO:teuthology.orchestra.run.smithi133.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-02-24T12:42:00.512 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-02-24T12:42:00.621 INFO:teuthology.orchestra.run.smithi133.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-24T12:42:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:tar: Error is not recoverable: exiting now
2022-02-24T12:42:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-24T12:42:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:tar: Error is not recoverable: exiting now
2022-02-24T12:42:00.661 INFO:teuthology.misc:Compressing logs...
2022-02-24T12:42:00.933 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-24T12:42:01.091 INFO:teuthology.misc:Compressing logs...
2022-02-24T12:42:01.166 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/cephadm.log: file size changed while zipping
2022-02-24T12:42:05.260 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-mon.smithi142.log: file size changed while zipping
2022-02-24T12:42:20.825 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-02-24T12:42:26.608 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-02-24T12:42:26.750 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-mgr.smithi142.wezvjj.log: file size changed while zipping
2022-02-24T12:42:33.563 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-02-24T12:42:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-mon.smithi133.log: file size changed while zipping
2022-02-24T12:42:49.073 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-mgr.smithi133.wvjtdr.log: file size changed while zipping
2022-02-24T12:42:51.815 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-02-24T12:43:09.207 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-02-24T12:43:11.727 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-02-24T12:43:28.341 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-02-24T12:43:34.072 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/b84e7526-9539-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-02-24T12:44:10.517 INFO:teuthology.kill:No teuthology processes running
2022-02-24T12:44:11.683 INFO:teuthology.kill:Nuking machines: ['smithi133', 'smithi142']
2022-02-24T12:44:12.627 INFO:teuthology.kill:2022-02-24 12:44:12,627.627 INFO:teuthology.nuke:targets:
2022-02-24T12:44:12.628 INFO:teuthology.kill:  smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAQw8upnTcDPKTkSSR/4bUJW9p41V8uaJR83uKaRLlc6INJrASBqvrxI9Vz9V2KMRtxbJ6TbgwlBlCnS1jq1zFv5jF1nks/XRzGnorLxdK4sZxfdgY+BgJlX5Wi8udQNDqzhn2rodN2voKxOaSQIqO/rHL3jjxDb+WpkH05d6dmR4VvIIoNY6yj5CWXcoycdAHIKnLPKmCr5EzBwSonhpahNOJ5UeBJO2QZ83mtZ+HvbgH0LAUnHNL/kEPcE3mdUTjFpqCyX/an58aamNf8VAa1RWIcvtNWRwuJ+TxcJ5ruZElI1uk7b38G01v2ElUXblKB6evBK86hpQv/mdekURbMjY4S0QYzJQf4kplES4LcQXrCTqtyqgFQRkKREB0Hzg0z7sEBASX4wU3LPnlhNjvIB7Ehjvst7kkKL+u2CAff/d1HIr3zgA10OtQsqlf/5Kguq3XK0DTwWoIVl261e0k6kFgE7rlkrIshs3QLDQ+qj+BqhFDw2S7hzDxyZcYo/0=
2022-02-24T12:44:12.629 INFO:teuthology.kill:  smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKEA+Px4xpPmiKint557HMQlVsbJThUZL5q2kXA4Fk79uvaQxGPGeeJ1nrIgcz5xfI8hxjGWZbKpDqp3x8XsuNhLSZMhWQm8yF4MvfV1a06FqGQfYGAH/xU/aIt1bVilIZarPXNhGbLFfhHuM1XS2pyL6J+OVJdtsjM4v9pqqWfcbaqaet7lUR9YjTof/2EKFjFUKQJrefdpMF71wi7C2hIlVTsB01W/9T82jE0+LSpasoVrCwYzGcrI+6e4ysM9JmU8/4b6DLyLVGOSNV5OSQaCww1MBSXA7739h6E/trUN/XZ6clXRxnamxiLZk1OnccgYF22sK/hjJrXRAvs5oT/vGb4Rv+vZqcGptO8IHB3k39cHPdsVBre56NO7QTnm9ptSKhZ0K0uqxrp+fsxDh3lXvhV1XDN0l+adyuHkrnBLBP5J4LxlBOJosN4NMMKgo3y+kpTQkCLLuCdDiO4drx+c0c9r/ofeG+iSASlHbh4r6IbL53YwsqEMZ5h/HuN0s=
2022-02-24T12:44:12.654 INFO:teuthology.kill:2022-02-24 12:44:12,654.654 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-24T12:44:12.657 INFO:teuthology.kill:2022-02-24 12:44:12,657.657 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-24T12:44:12.742 INFO:teuthology.kill:2022-02-24 12:44:12,741.741 INFO:teuthology.orchestra.console:Power off smithi142
2022-02-24T12:44:12.756 INFO:teuthology.kill:2022-02-24 12:44:12,756.756 INFO:teuthology.orchestra.console:Power off smithi133
2022-02-24T12:44:25.231 INFO:teuthology.kill:2022-02-24 12:44:25,231.231 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-02-24T12:44:25.238 INFO:teuthology.kill:2022-02-24 12:44:25,238.238 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2022-02-24T12:44:25.380 INFO:teuthology.kill:2022-02-24 12:44:25,379.379 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com
2022-02-24T12:44:25.384 INFO:teuthology.kill:2022-02-24 12:44:25,384.384 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com
2022-02-24T12:46:25.683 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-24T12:46:25.784 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi133 but it was locked by another job: /home/teuthworker/archive/sseshasa-2022-02-24_11:27:07-rados-wip-45118-45121-quincy-testing-distro-default-smithi/6704362