2022-01-07T00:28:53.008 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-07T00:28:53.146 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging 2022-01-07T00:28:53.147 INFO:teuthology.lock.ops:Updating [ubuntu@smithi162.front.sepia.ceph.com]: reset os type and version on server 2022-01-07T00:28:53.148 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2022-01-07T00:28:53.168 INFO:teuthology.lock.ops:Node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging is complete 2022-01-07T00:28:53.168 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging 2022-01-07T00:28:53.169 INFO:teuthology.lock.ops:Updating [ubuntu@smithi198.front.sepia.ceph.com]: reset os type and version on server 2022-01-07T00:28:53.169 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server 2022-01-07T00:28:53.190 INFO:teuthology.lock.ops:Node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging is complete 2022-01-07T00:28:53.379 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of rhel 8.4 2022-01-07T00:28:53.399 INFO:teuthology.provision.fog.smithi198:Scheduling deploy of rhel 8.4 2022-01-07T00:28:53.757 INFO:teuthology.orchestra.console:Power off smithi162 2022-01-07T00:28:53.786 INFO:teuthology.orchestra.console:Power off smithi198 2022-01-07T00:28:53.924 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2022-01-07T00:28:53.937 INFO:teuthology.orchestra.console:Power off for smithi198 completed 2022-01-07T00:28:54.026 INFO:teuthology.orchestra.console:Power on smithi162 2022-01-07T00:28:54.039 INFO:teuthology.orchestra.console:Power on smithi198 2022-01-07T00:28:58.288 INFO:teuthology.orchestra.console:Power on for smithi162 completed 2022-01-07T00:28:58.389 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2022-01-07T00:29:02.405 INFO:teuthology.orchestra.console:Power on for smithi198 completed 2022-01-07T00:29:02.506 INFO:teuthology.provision.fog.smithi198:Waiting for deploy to finish 2022-01-07T00:33:25.785 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-07T00:33:45.802 INFO:teuthology.provision.fog.smithi162:Node is ready 2022-01-07T00:33:45.825 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2022-01-07T00:33:45.882 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2022-01-07T00:33:46.234 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2022-01-07T00:34:07.415 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-07T00:34:07.626 INFO:teuthology.provision.fog.smithi198:Node is ready 2022-01-07T00:34:07.641 INFO:teuthology.orchestra.run.smithi198.stdout:smithi198.front.sepia.ceph.com 2022-01-07T00:34:07.697 INFO:teuthology.orchestra.run.smithi198.stdout:172.21.15.198 smithi198.front.sepia.ceph.com smithi198 2022-01-07T00:34:08.020 INFO:teuthology.provision.fog.smithi198:Deploy complete! 2022-01-07T00:34:08.186 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2022-01-07T00:34:08.187 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-07T00:34:08.208 INFO:teuthology.lock.ops:Checking smithi198.front.sepia.ceph.com 2022-01-07T00:34:08.209 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-07T00:34:08.228 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2022-01-07T00:34:08.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2022-01-07T00:34:08.460 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2022-01-07T00:34:08.515 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux" 2022-01-07T00:34:08.515 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.4 (Ootpa)" 2022-01-07T00:34:08.515 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel" 2022-01-07T00:34:08.516 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora" 2022-01-07T00:34:08.516 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.4" 2022-01-07T00:34:08.516 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2022-01-07T00:34:08.516 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-07T00:34:08.516 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2022-01-07T00:34:08.517 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-07T00:34:08.517 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/" 2022-01-07T00:34:08.517 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-07T00:34:08.517 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-07T00:34:08.518 INFO:teuthology.orchestra.run.smithi162.stdout: 2022-01-07T00:34:08.518 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-07T00:34:08.518 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-07T00:34:08.518 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-07T00:34:08.519 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-07T00:34:08.520 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2022-01-07T00:34:08.538 INFO:teuthology.lock.ops:Updating [smithi198.front.sepia.ceph.com]: set os type and version on server 2022-01-07T00:34:08.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com' 2022-01-07T00:34:08.727 INFO:teuthology.orchestra.run.smithi198.stdout:x86_64 2022-01-07T00:34:08.786 INFO:teuthology.orchestra.run.smithi198.stdout:NAME="Red Hat Enterprise Linux" 2022-01-07T00:34:08.786 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION="8.4 (Ootpa)" 2022-01-07T00:34:08.787 INFO:teuthology.orchestra.run.smithi198.stdout:ID="rhel" 2022-01-07T00:34:08.787 INFO:teuthology.orchestra.run.smithi198.stdout:ID_LIKE="fedora" 2022-01-07T00:34:08.787 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_ID="8.4" 2022-01-07T00:34:08.787 INFO:teuthology.orchestra.run.smithi198.stdout:PLATFORM_ID="platform:el8" 2022-01-07T00:34:08.788 INFO:teuthology.orchestra.run.smithi198.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-07T00:34:08.788 INFO:teuthology.orchestra.run.smithi198.stdout:ANSI_COLOR="0;31" 2022-01-07T00:34:08.788 INFO:teuthology.orchestra.run.smithi198.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-07T00:34:08.788 INFO:teuthology.orchestra.run.smithi198.stdout:HOME_URL="https://www.redhat.com/" 2022-01-07T00:34:08.788 INFO:teuthology.orchestra.run.smithi198.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-07T00:34:08.789 INFO:teuthology.orchestra.run.smithi198.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-07T00:34:08.789 INFO:teuthology.orchestra.run.smithi198.stdout: 2022-01-07T00:34:08.789 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-07T00:34:08.789 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-07T00:34:08.789 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-07T00:34:08.790 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-07T00:34:08.790 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server 2022-01-07T00:34:08.900 INFO:teuthology.dispatcher.supervisor:Running job 6599316 2022-01-07T00:34:08.901 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599316 --name yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599316/orig.config.yaml 2022-01-07T00:34:08.906 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599316 2022-01-07T00:34:08.907 INFO:teuthology.dispatcher.supervisor:Job PID: 717 2022-01-07T00:34:08.907 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-07T12:34:29.320 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-07T12:34:29.536 INFO:teuthology.kill:Killing Pids: {717} 2022-01-07T12:34:30.764 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-07T12:34:30.765 INFO:teuthology.task.internal:roles: ubuntu@smithi198.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-07T12:34:30.765 INFO:teuthology.misc:Compressing logs... 2022-01-07T12:34:30.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2022-01-07T12:34:30.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com' 2022-01-07T12:34:31.002 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-07T12:34:31.198 INFO:teuthology.orchestra.run.smithi198.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-07T12:34:31.245 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-07T12:34:31.246 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2022-01-07T12:34:31.289 INFO:teuthology.orchestra.run.smithi198.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-07T12:34:31.290 INFO:teuthology.orchestra.run.smithi198.stderr:tar: Error is not recoverable: exiting now 2022-01-07T12:34:31.292 INFO:teuthology.misc:Compressing logs... 2022-01-07T12:34:31.524 INFO:teuthology.misc:Compressing logs... 2022-01-07T12:34:45.107 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-07T12:34:49.492 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-07T12:34:56.027 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-mon.smithi198.log: file size changed while zipping 2022-01-07T12:34:58.562 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-07T12:35:09.064 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-07T12:35:13.435 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-07T12:35:16.622 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-mgr.smithi162.zetcyo.log: file size changed while zipping 2022-01-07T12:35:26.790 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-07T12:35:34.606 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-07T12:35:40.478 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-07T12:35:51.814 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/feb4bc08-6f52-11ec-8c32-001a4aab830c/ceph-mon.smithi162.log: file size changed while zipping 2022-01-07T12:36:23.227 INFO:teuthology.kill:No teuthology processes running 2022-01-07T12:36:24.361 INFO:teuthology.kill:Nuking machines: ['smithi162', 'smithi198'] 2022-01-07T12:36:25.411 INFO:teuthology.kill:2022-01-07 12:36:25,411.411 INFO:teuthology.nuke:targets: 2022-01-07T12:36:25.412 INFO:teuthology.kill: smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu4x43DKVYQw82ehHaM7xnoOrZ/+m+UWAiIeXDZp7QWaFpDwo/qEwCKKo7X3zpcF7h5ngibnpGkpZekh8PFp3VD6N+WvA7Eiaxt5B5dXqjNy4qvKxGrLNLgAhOyzXCYYXfdBRwN34tlDjOPGhjBAes+Borv/qv8ivQRoGz1AG1j4BB+pfwkH2WeEHAcD6GLL0eHMeHYyzUED32EacIzV/yEgF7puYgiJ/EdPw1C3oAxEnvxuMS8gbgMy72bhWCY4mCtDxAUn+S4+J94iIojPs8yb8zKjQXtCjs7zlu4fJOP1+1GgPyPATwknPisHdiE4EX1fuRe7luYLW7O3bc2iA/XaYqBnRWzf0PIN4K0iMuYgxOeU8mChe/LkYDifU0Lu9JTESGYrR8SLCe0iNmv+/3x9uEuRs+puKYp+JNpk5mq5/VqU+JoetzWz5xle+ps5v4i/8E6Q0kkG0Mg/68JIUC9wPT2n7N7H4WddIDnhygU61MC6qGesut84rXl/Ebogs= 2022-01-07T12:36:25.413 INFO:teuthology.kill: smithi198.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1/R9loWysQMrPTuS5BgZnLY0sG7lA/gVqwA8McUBfeU+PMQLUeu/nEFXfKWupI8OcYTrQtlG6Y+jGC45rN8Z1+RxGBKFK2cliKAZrWMdYmy6syKn2QJdkmmhn6dKS6BVYG9sPYt0te6YntkGrrQXCKP5bufcKPY1Of1aLeWgJ3731HMuHGCZgupqRl+CCsUmQA0rcoHbTxUqcoNgdb2VWM1qGTeIfo3Vp1j/r/Uqb2NWL+dA/Rjdv7a5n0leEVWnSilzRMH4xTSkdWlBhJXkuxAZ3y7EzLMsgF7vReB7KN4qacBW3Hj5xrTnHYxts2xPZ5WhS7BQs7HPIjncHEbi5S5DYh83kfTkE/41JER5T6OVIqAqVdfl+4bMHomNA5A23xnWSeYqwM3MVkV9haZ6f9W2xZrnwyKouo4OJl2Rai/V4FYLhi1lh7iO8AIEVyI82XZqoci9rIIWiCD1EsY1TLlhUQtt06Pg4Zsm40NgkJWGLi0nsxZFFfO4HQhmRwFU= 2022-01-07T12:36:25.438 INFO:teuthology.kill:2022-01-07 12:36:25,438.438 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-07T12:36:25.441 INFO:teuthology.kill:2022-01-07 12:36:25,441.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-07T12:36:25.521 INFO:teuthology.kill:2022-01-07 12:36:25,520.520 INFO:teuthology.orchestra.console:Power off smithi198 2022-01-07T12:36:25.536 INFO:teuthology.kill:2022-01-07 12:36:25,536.536 INFO:teuthology.orchestra.console:Power off smithi162 2022-01-07T12:36:33.897 INFO:teuthology.kill:2022-01-07 12:36:33,897.897 INFO:teuthology.orchestra.console:Power off for smithi198 completed 2022-01-07T12:36:33.903 INFO:teuthology.kill:2022-01-07 12:36:33,902.902 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2022-01-07T12:36:34.049 INFO:teuthology.kill:2022-01-07 12:36:34,048.048 INFO:teuthology.lock.ops:unlocked: smithi198.front.sepia.ceph.com 2022-01-07T12:36:34.053 INFO:teuthology.kill:2022-01-07 12:36:34,052.052 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com 2022-01-07T12:38:34.372 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-07T12:38:34.495 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi162 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600960 2022-01-07T12:38:34.495 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi198 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600960