2022-01-05T07:24:19.405 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-05T07:24:19.521 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging
2022-01-05T07:24:19.522 INFO:teuthology.lock.ops:Updating [ubuntu@smithi050.front.sepia.ceph.com]: reset os type and version on server
2022-01-05T07:24:19.523 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-01-05T07:24:19.541 INFO:teuthology.lock.ops:Node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging is complete
2022-01-05T07:24:19.542 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi187.front.sepia.ceph.com' reimaging
2022-01-05T07:24:19.542 INFO:teuthology.lock.ops:Updating [ubuntu@smithi187.front.sepia.ceph.com]: reset os type and version on server
2022-01-05T07:24:19.543 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2022-01-05T07:24:19.563 INFO:teuthology.lock.ops:Node 'ubuntu@smithi187.front.sepia.ceph.com' reimaging is complete
2022-01-05T07:24:19.758 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream
2022-01-05T07:24:19.766 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream
2022-01-05T07:24:20.125 INFO:teuthology.orchestra.console:Power off smithi050
2022-01-05T07:24:20.168 INFO:teuthology.orchestra.console:Power off smithi187
2022-01-05T07:24:28.502 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-01-05T07:24:28.603 INFO:teuthology.orchestra.console:Power on smithi050
2022-01-05T07:24:32.640 INFO:teuthology.orchestra.console:Power off for smithi187 completed
2022-01-05T07:24:32.742 INFO:teuthology.orchestra.console:Power on smithi187
2022-01-05T07:24:36.975 INFO:teuthology.orchestra.console:Power on for smithi050 completed
2022-01-05T07:24:37.076 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2022-01-05T07:24:41.109 INFO:teuthology.orchestra.console:Power on for smithi187 completed
2022-01-05T07:24:41.211 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2022-01-05T07:28:17.864 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-05T07:28:38.238 INFO:teuthology.provision.fog.smithi050:Node is ready
2022-01-05T07:28:38.261 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2022-01-05T07:28:38.320 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2022-01-05T07:28:38.675 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2022-01-05T07:28:52.920 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-05T07:29:12.816 INFO:teuthology.provision.fog.smithi187:Node is ready
2022-01-05T07:29:12.837 INFO:teuthology.orchestra.run.smithi187.stdout:smithi126
2022-01-05T07:29:12.896 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.126 smithi126.front.sepia.ceph.com smithi126
2022-01-05T07:29:13.254 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2022-01-05T07:29:13.406 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2022-01-05T07:29:13.407 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-05T07:29:13.427 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2022-01-05T07:29:13.427 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-05T07:29:13.445 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2022-01-05T07:29:13.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-01-05T07:29:13.696 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2022-01-05T07:29:13.753 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2022-01-05T07:29:13.754 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8"
2022-01-05T07:29:13.754 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2022-01-05T07:29:13.754 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2022-01-05T07:29:13.755 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8"
2022-01-05T07:29:13.755 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2022-01-05T07:29:13.755 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-05T07:29:13.755 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2022-01-05T07:29:13.756 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-05T07:29:13.756 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2022-01-05T07:29:13.756 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-05T07:29:13.757 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-05T07:29:13.757 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-05T07:29:13.759 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-01-05T07:29:13.777 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2022-01-05T07:29:13.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2022-01-05T07:29:13.963 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2022-01-05T07:29:14.019 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2022-01-05T07:29:14.019 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8"
2022-01-05T07:29:14.020 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2022-01-05T07:29:14.020 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2022-01-05T07:29:14.020 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8"
2022-01-05T07:29:14.020 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8"
2022-01-05T07:29:14.020 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-05T07:29:14.021 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2022-01-05T07:29:14.021 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-05T07:29:14.021 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2022-01-05T07:29:14.021 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-05T07:29:14.022 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-05T07:29:14.022 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-05T07:29:14.022 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2022-01-05T07:29:14.114 INFO:teuthology.dispatcher.supervisor:Running job 6595141
2022-01-05T07:29:14.114 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2022-01-04_21:11:23-rados-wip-sage2-testing-2022-01-03-1413-distro-basic-smithi/6595141 --name sage-2022-01-04_21:11:23-rados-wip-sage2-testing-2022-01-03-1413-distro-basic-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/sage-2022-01-04_21:11:23-rados-wip-sage2-testing-2022-01-03-1413-distro-basic-smithi/6595141/orig.config.yaml
2022-01-05T07:29:14.117 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2022-01-04_21:11:23-rados-wip-sage2-testing-2022-01-03-1413-distro-basic-smithi/6595141
2022-01-05T07:29:14.118 INFO:teuthology.dispatcher.supervisor:Job PID: 1676
2022-01-05T07:29:14.118 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-05T19:30:06.834 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-05T19:30:07.097 INFO:teuthology.kill:Killing Pids: {1676}
2022-01-05T19:30:08.255 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-05T19:30:08.256 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-05T19:30:08.256 INFO:teuthology.misc:Compressing logs...
2022-01-05T19:30:08.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-01-05T19:30:08.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2022-01-05T19:30:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-05T19:30:08.695 INFO:teuthology.orchestra.run.smithi187.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-05T19:30:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-05T19:30:08.743 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now
2022-01-05T19:30:08.818 INFO:teuthology.orchestra.run.smithi187.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-05T19:30:08.818 INFO:teuthology.orchestra.run.smithi187.stderr:tar: Error is not recoverable: exiting now
2022-01-05T19:30:08.819 INFO:teuthology.misc:Compressing logs...
2022-01-05T19:30:09.423 INFO:teuthology.misc:Compressing logs...
2022-01-05T19:30:36.500 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-05T19:30:39.515 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-05T19:31:01.916 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-05T19:31:04.732 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-05T19:31:20.125 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-05T19:31:30.343 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-05T19:31:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-05T19:31:52.472 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-05T19:32:02.947 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-mon.smithi187.log: file size changed while zipping
2022-01-05T19:32:07.395 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-mgr.smithi187.ekisgi.log: file size changed while zipping
2022-01-05T19:32:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/5a3bde58-6dfa-11ec-8c32-001a4aab830c/ceph-mon.smithi050.log: file size changed while zipping
2022-01-05T19:32:55.648 INFO:teuthology.kill:No teuthology processes running
2022-01-05T19:32:56.828 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi187']
2022-01-05T19:32:57.780 INFO:teuthology.kill:2022-01-05 19:32:57,779.779 INFO:teuthology.nuke:targets:
2022-01-05T19:32:57.780 INFO:teuthology.kill:  smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqgXxYgYXKQoz4H9kPlh7WOdVeGQ+T0y6vt9LCJ7vKvt+QmiQjkB2EKdaP1riLYxgKISYtHGN0nSc5Vai5YnAquxyEcoTbfgVc+Gu45egbQ0g6Mld/6wR1z3jEFaB/z2MkFw90emnAdmrR2tD2DiZGSLQpyMBfD1NrTFD3n2M2LEFj90Xbh9CzvSsQutfoKMLioZYe8XC5EybiFscbsJ6fMsQzZFPkBH90hlFFYwLvzmjXULOhuhUOjpVbyaM9ncpySl115CmCW0cNiRsDJG8DnH5O8Rm2WSLio+EJOOyOQbAN2r0lMwsERzzgHiZAP+lAoidrjqFmldIBpEh+ljRNBveeunmP189MrWB/CtmuazVKKxRN3rb9tiHbQvDvfH6U+sOdW94L51I6wGGVPtEXFnJr3K96V7R1aMaP6A2235AtAhCz+hfHw92lftVF5Sgktv7SMbCxkTp+6f9GKlB0xYqXwBBJYi08ICylVn51vnr/fT/Z/pECPqct+Pmt6Ks=
2022-01-05T19:32:57.781 INFO:teuthology.kill:  smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC68QmSa+gfE2UEOKHP5JYQGDsUtCIoHPaIzTZxxAXndSd6d8QiH9FE9P4VLfOOEltj0e/fo/ifK1KFXrw311eewJlV1FKZI+sVnGakSolZCqUgTjOvIirbgl/rsU1JLAk6WkEEz+63S0WxMWWQgn9LMkJPmG8Mfglj18yUkDT+4DV7i5undmdIGYRAo7SWTfBlnjR5oNexRAxR0n4TDNndl2tNZ5AGVMxrJAKF9+WQ9RrEUIUjRgfnPcCCJAjGyuxiiq/t3yXlrUo2r6tgjLkZnuijosQh6bxfgmxIAhJ2zDT48B2Z3kZipzUWUH//bzGOs5Vf0/c3wHlsAH4V8SH9CC/M4jCj85QrDRRn4KpAaheYpAVN+RRe1egaogKUFAARUCKSrpKBIFkaj6ms2jb8ttxKvHdk+WCeqhhnxyfiYhHIGtbIaatyYQ13MWB/0NUJWeELiRwc1w1oZ5krhVyTkMu9IKhouj6h24syHsOXFzD+E0SUZ0Dj4VlXw/usD7E=
2022-01-05T19:32:57.805 INFO:teuthology.kill:2022-01-05 19:32:57,805.805 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-05T19:32:57.809 INFO:teuthology.kill:2022-01-05 19:32:57,808.808 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-05T19:32:57.883 INFO:teuthology.kill:2022-01-05 19:32:57,883.883 INFO:teuthology.orchestra.console:Power off smithi187
2022-01-05T19:32:57.896 INFO:teuthology.kill:2022-01-05 19:32:57,896.896 INFO:teuthology.orchestra.console:Power off smithi050
2022-01-05T19:33:06.254 INFO:teuthology.kill:2022-01-05 19:33:06,254.254 INFO:teuthology.orchestra.console:Power off for smithi187 completed
2022-01-05T19:33:06.260 INFO:teuthology.kill:2022-01-05 19:33:06,260.260 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-01-05T19:33:06.402 INFO:teuthology.kill:2022-01-05 19:33:06,401.401 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2022-01-05T19:33:06.406 INFO:teuthology.kill:2022-01-05 19:33:06,406.406 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com
2022-01-05T19:35:06.726 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-05T19:35:06.825 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/lflores-2022-01-05_19:04:35-rados-wip-lflores-mgr-rocksdb-distro-default-smithi/6596518
2022-01-05T19:35:06.826 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi187 but it was locked by another job: /home/teuthworker/archive/lflores-2022-01-05_19:04:35-rados-wip-lflores-mgr-rocksdb-distro-default-smithi/6596518