2022-03-23T23:12:48.033 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-23T23:12:48.150 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging
2022-03-23T23:12:48.152 INFO:teuthology.lock.ops:Updating [ubuntu@smithi005.front.sepia.ceph.com]: reset os type and version on server
2022-03-23T23:12:48.154 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2022-03-23T23:12:48.172 INFO:teuthology.lock.ops:Node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging is complete
2022-03-23T23:12:48.173 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi120.front.sepia.ceph.com' reimaging
2022-03-23T23:12:48.173 INFO:teuthology.lock.ops:Updating [ubuntu@smithi120.front.sepia.ceph.com]: reset os type and version on server
2022-03-23T23:12:48.173 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2022-03-23T23:12:48.192 INFO:teuthology.lock.ops:Node 'ubuntu@smithi120.front.sepia.ceph.com' reimaging is complete
2022-03-23T23:12:48.397 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 8.stream
2022-03-23T23:12:48.428 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.stream
2022-03-23T23:12:48.876 INFO:teuthology.orchestra.console:Power off smithi120
2022-03-23T23:12:48.917 INFO:teuthology.orchestra.console:Power off smithi005
2022-03-23T23:12:57.251 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2022-03-23T23:12:57.277 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2022-03-23T23:12:57.353 INFO:teuthology.orchestra.console:Power on smithi120
2022-03-23T23:12:57.383 INFO:teuthology.orchestra.console:Power on smithi005
2022-03-23T23:13:05.750 INFO:teuthology.orchestra.console:Power on for smithi005 completed
2022-03-23T23:13:05.835 INFO:teuthology.orchestra.console:Power on for smithi120 completed
2022-03-23T23:13:05.851 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish
2022-03-23T23:13:05.936 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2022-03-23T23:17:14.090 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-23T23:17:14.334 INFO:teuthology.provision.fog.smithi005:Node is ready
2022-03-23T23:17:14.354 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com
2022-03-23T23:17:14.412 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005
2022-03-23T23:17:14.770 INFO:teuthology.provision.fog.smithi005:Deploy complete!
2022-03-23T23:17:38.323 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-23T23:17:38.564 INFO:teuthology.provision.fog.smithi120:Node is ready
2022-03-23T23:17:38.582 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com
2022-03-23T23:17:38.639 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2022-03-23T23:17:38.964 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2022-03-23T23:17:39.147 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com
2022-03-23T23:17:39.148 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-23T23:17:39.167 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2022-03-23T23:17:39.168 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-23T23:17:39.185 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server
2022-03-23T23:17:39.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com'
2022-03-23T23:17:39.434 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64
2022-03-23T23:17:39.491 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream"
2022-03-23T23:17:39.492 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8"
2022-03-23T23:17:39.492 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos"
2022-03-23T23:17:39.492 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora"
2022-03-23T23:17:39.492 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8"
2022-03-23T23:17:39.493 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8"
2022-03-23T23:17:39.493 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-23T23:17:39.493 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31"
2022-03-23T23:17:39.493 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-23T23:17:39.494 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/"
2022-03-23T23:17:39.494 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-23T23:17:39.494 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-23T23:17:39.494 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-23T23:17:39.495 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2022-03-23T23:17:39.514 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2022-03-23T23:17:39.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2022-03-23T23:17:39.703 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2022-03-23T23:17:39.760 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2022-03-23T23:17:39.760 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8"
2022-03-23T23:17:39.761 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2022-03-23T23:17:39.761 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2022-03-23T23:17:39.761 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8"
2022-03-23T23:17:39.761 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2022-03-23T23:17:39.762 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-23T23:17:39.762 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2022-03-23T23:17:39.762 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-23T23:17:39.762 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2022-03-23T23:17:39.763 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-23T23:17:39.763 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-23T23:17:39.763 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-23T23:17:39.764 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2022-03-23T23:17:39.862 INFO:teuthology.dispatcher.supervisor:Running job 6756156
2022-03-23T23:17:39.862 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-23_20:43:24-orch-wip-yuri6-testing-2022-03-23-1009-pacific-distro-default-smithi/6756156 --name yuriw-2022-03-23_20:43:24-orch-wip-yuri6-testing-2022-03-23-1009-pacific-distro-default-smithi --description orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} -- /home/teuthworker/archive/yuriw-2022-03-23_20:43:24-orch-wip-yuri6-testing-2022-03-23-1009-pacific-distro-default-smithi/6756156/orig.config.yaml
2022-03-23T23:17:39.866 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-23_20:43:24-orch-wip-yuri6-testing-2022-03-23-1009-pacific-distro-default-smithi/6756156
2022-03-23T23:17:39.867 INFO:teuthology.dispatcher.supervisor:Job PID: 22777
2022-03-23T23:17:39.867 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-24T05:48:07.680 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-24T05:48:07.809 INFO:teuthology.kill:Killing Pids: {22777}
2022-03-24T05:48:08.987 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2022-03-24T05:48:08.988 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2022-03-24T05:48:08.988 INFO:teuthology.misc:Compressing logs...
2022-03-24T05:48:08.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com'
2022-03-24T05:48:09.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2022-03-24T05:48:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-24T05:48:09.395 INFO:teuthology.orchestra.run.smithi120.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-24T05:48:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-24T05:48:09.440 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now
2022-03-24T05:48:09.478 INFO:teuthology.orchestra.run.smithi120.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-24T05:48:09.478 INFO:teuthology.orchestra.run.smithi120.stderr:tar: Error is not recoverable: exiting now
2022-03-24T05:48:09.479 INFO:teuthology.misc:Compressing logs...
2022-03-24T05:48:09.722 INFO:teuthology.misc:Compressing logs...
2022-03-24T05:48:20.630 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-24T05:48:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-24T05:48:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2022-03-24T05:48:31.878 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-24T05:48:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-24T05:48:35.356 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-03-24T05:48:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-03-24T05:48:41.726 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-24T05:48:44.627 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-03-24T05:48:52.281 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-24T05:48:56.780 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-24T05:49:07.234 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/a047796e-ab00-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-03-24T05:49:28.302 INFO:teuthology.kill:No teuthology processes running
2022-03-24T05:49:29.475 INFO:teuthology.kill:Nuking machines: ['smithi005', 'smithi120']
2022-03-24T05:49:30.477 INFO:teuthology.kill:2022-03-24 05:49:30,477.477 INFO:teuthology.nuke:targets:
2022-03-24T05:49:30.478 INFO:teuthology.kill:  smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEHHG5rQ3a+RxGgCQSepvThO9WfxLw1etCzwfeFumr0F8WcV/JU17y6HCr0gNqXcDKFGPXh6OKQ5T8DJzWAkIm1Wth7y2Davq9UnLcKXq93NpEFVnBiLRbi46emVGHjlYLrh1woSlUQxxBbbGa2gXo570dIQbyplt0cc2UvQb9i0G2KZn0rCwNp8Je7+z8oipqYEzMQZx8ESDla4OMhVKK3nlfhUDXj/ZLd9FEa2jSg/sMxiWL3lAtmT0FCr5QECp1v5VOUoEgpzZqszbETW3nbvuJWjhsQ7D39kd602kfgX6L/79vsxCy+4R+BH/CTraMOXud93vGm6c75DQrQEXUE5ZB5kjA4ykyrPY10CTaU/qncI7PUf784Jud1cuGx381YMZ1EPwdkqDmVYp7SB/1E6oWgg5Fe4GFBrQPakivuPSES+apXngczPjgRRq4iA/iX5rsYyOw6ZX749hAdAT+9mwZYWfNfTaIzpBnNFpcFa1UZaJj0hYLBqInDdD05Y8=
2022-03-24T05:49:30.478 INFO:teuthology.kill:  smithi120.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8R0tsvib4/7TJqvbMr/nS0uBOfkhojMcy4t7e1h23XFtSW7oFIgSwPNXd6t/YZrF+pqR2VaUAHmVSEsoyTeDxJrCUnrWDG/du5aRwoS7fVdYxBZmHSa31iv6qw+2bBHCOzekWzLOdHXnJ4DvH1Y0IAa8WU4D4UwphMFlGzgJ6USfvf29Low/e1dPJtgH816+RKblX0+6Y8b+F2Kuq6BZ5is/d+PrrQoyW3y0avmSpP+KFFTnIdE7ziXRDndktg/jP6Gh2NhsOC33sBjFSftMKFjOA2GIe+wweIPZTGwbOGTqov2ZfgmigF14c5hSQU2XMk3Ln6/KTAKKicUPHmsHn/ql8kJCSZ+3fnu/RZaZ7fuNFQNIwcAHlufHS8CzUc6wwZiaAc03Nc8XL5lZXHmsuxExgo54NyUSW6Sffua4b1G1na9mEK6L3KcwpwjGjVZo2kX6JmWDdxF6MsY60cAyr6M+n34dqQnbjpHi4XwBgFYUivXIYnd4+WVG/cCtjJ4s=
2022-03-24T05:49:30.506 INFO:teuthology.kill:2022-03-24 05:49:30,505.505 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-24T05:49:30.510 INFO:teuthology.kill:2022-03-24 05:49:30,509.509 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-24T05:49:30.585 INFO:teuthology.kill:2022-03-24 05:49:30,585.585 INFO:teuthology.orchestra.console:Power off smithi120
2022-03-24T05:49:30.598 INFO:teuthology.kill:2022-03-24 05:49:30,598.598 INFO:teuthology.orchestra.console:Power off smithi005
2022-03-24T05:49:38.954 INFO:teuthology.kill:2022-03-24 05:49:38,953.953 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2022-03-24T05:49:38.964 INFO:teuthology.kill:2022-03-24 05:49:38,964.964 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2022-03-24T05:49:39.110 INFO:teuthology.kill:2022-03-24 05:49:39,109.109 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com
2022-03-24T05:49:39.114 INFO:teuthology.kill:2022-03-24 05:49:39,113.113 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com
2022-03-24T05:51:39.425 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-24T05:51:39.547 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi005 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-24_01:58:56-rados-wip-yuri7-testing-2022-03-23-1332-quincy-distro-default-smithi/6756706
2022-03-24T05:51:39.548 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi120 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-24_01:58:56-rados-wip-yuri7-testing-2022-03-23-1332-quincy-distro-default-smithi/6756707