2022-01-11T02:22:00.245 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-11T02:22:00.367 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi042.front.sepia.ceph.com' reimaging 2022-01-11T02:22:00.368 INFO:teuthology.lock.ops:Updating [ubuntu@smithi042.front.sepia.ceph.com]: reset os type and version on server 2022-01-11T02:22:00.368 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2022-01-11T02:22:00.386 INFO:teuthology.lock.ops:Node 'ubuntu@smithi042.front.sepia.ceph.com' reimaging is complete 2022-01-11T02:22:00.387 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging 2022-01-11T02:22:00.387 INFO:teuthology.lock.ops:Updating [ubuntu@smithi043.front.sepia.ceph.com]: reset os type and version on server 2022-01-11T02:22:00.387 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2022-01-11T02:22:00.416 INFO:teuthology.lock.ops:Node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging is complete 2022-01-11T02:22:00.597 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of rhel 8.4 2022-01-11T02:22:00.618 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.4 2022-01-11T02:22:00.936 INFO:teuthology.orchestra.console:Power off smithi042 2022-01-11T02:22:00.975 INFO:teuthology.orchestra.console:Power off smithi043 2022-01-11T02:22:09.309 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2022-01-11T02:22:09.335 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2022-01-11T02:22:09.411 INFO:teuthology.orchestra.console:Power on smithi042 2022-01-11T02:22:09.439 INFO:teuthology.orchestra.console:Power on smithi043 2022-01-11T02:22:17.781 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2022-01-11T02:22:17.793 INFO:teuthology.orchestra.console:Power on for smithi043 completed 2022-01-11T02:22:17.883 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2022-01-11T02:22:17.894 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2022-01-11T02:26:52.472 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-11T02:26:52.513 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-11T02:26:52.707 INFO:teuthology.provision.fog.smithi042:Node is ready 2022-01-11T02:26:52.722 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2022-01-11T02:26:52.734 INFO:teuthology.provision.fog.smithi043:Node is ready 2022-01-11T02:26:52.751 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2022-01-11T02:26:52.778 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2022-01-11T02:26:52.809 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2022-01-11T02:26:53.112 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2022-01-11T02:26:53.164 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2022-01-11T02:26:53.325 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2022-01-11T02:26:53.326 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-11T02:26:53.350 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2022-01-11T02:26:53.351 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-11T02:26:53.368 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2022-01-11T02:26:53.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2022-01-11T02:26:53.594 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2022-01-11T02:26:53.648 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Red Hat Enterprise Linux" 2022-01-11T02:26:53.648 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8.4 (Ootpa)" 2022-01-11T02:26:53.648 INFO:teuthology.orchestra.run.smithi042.stdout:ID="rhel" 2022-01-11T02:26:53.649 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="fedora" 2022-01-11T02:26:53.649 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8.4" 2022-01-11T02:26:53.649 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2022-01-11T02:26:53.649 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-11T02:26:53.650 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2022-01-11T02:26:53.650 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-11T02:26:53.650 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.redhat.com/" 2022-01-11T02:26:53.650 INFO:teuthology.orchestra.run.smithi042.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-11T02:26:53.650 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-11T02:26:53.651 INFO:teuthology.orchestra.run.smithi042.stdout: 2022-01-11T02:26:53.651 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-11T02:26:53.651 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-11T02:26:53.651 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-11T02:26:53.652 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-11T02:26:53.653 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2022-01-11T02:26:53.671 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2022-01-11T02:26:53.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2022-01-11T02:26:53.905 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2022-01-11T02:26:53.960 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2022-01-11T02:26:53.961 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.4 (Ootpa)" 2022-01-11T02:26:53.961 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2022-01-11T02:26:53.961 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2022-01-11T02:26:53.961 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.4" 2022-01-11T02:26:53.962 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2022-01-11T02:26:53.962 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-11T02:26:53.962 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2022-01-11T02:26:53.962 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-11T02:26:53.963 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2022-01-11T02:26:53.963 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-11T02:26:53.963 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-11T02:26:53.963 INFO:teuthology.orchestra.run.smithi043.stdout: 2022-01-11T02:26:53.963 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-11T02:26:53.964 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-11T02:26:53.964 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-11T02:26:53.964 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-11T02:26:53.965 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2022-01-11T02:26:54.070 INFO:teuthology.dispatcher.supervisor:Running job 6606590 2022-01-11T02:26:54.071 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606590 --name yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606590/orig.config.yaml 2022-01-11T02:26:54.074 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606590 2022-01-11T02:26:54.075 INFO:teuthology.dispatcher.supervisor:Job PID: 14147 2022-01-11T02:26:54.075 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-11T14:27:48.751 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-11T14:27:48.977 INFO:teuthology.kill:Killing Pids: {14147} 2022-01-11T14:27:50.180 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-11T14:27:50.181 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-11T14:27:50.181 INFO:teuthology.misc:Compressing logs... 2022-01-11T14:27:50.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2022-01-11T14:27:50.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2022-01-11T14:27:50.432 INFO:teuthology.orchestra.run.smithi042.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-11T14:27:50.666 INFO:teuthology.orchestra.run.smithi043.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-11T14:27:50.720 INFO:teuthology.orchestra.run.smithi042.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-11T14:27:50.720 INFO:teuthology.orchestra.run.smithi042.stderr:tar: Error is not recoverable: exiting now 2022-01-11T14:27:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-11T14:27:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:tar: Error is not recoverable: exiting now 2022-01-11T14:27:50.759 INFO:teuthology.misc:Compressing logs... 2022-01-11T14:27:50.993 INFO:teuthology.misc:Compressing logs... 2022-01-11T14:28:05.245 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-11T14:28:10.054 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-11T14:28:17.214 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-mon.smithi043.log: file size changed while zipping 2022-01-11T14:28:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-11T14:28:31.097 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-11T14:28:35.660 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-11T14:28:50.105 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-11T14:28:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-11T14:29:04.745 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-11T14:29:13.408 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-mon.smithi042.log: file size changed while zipping 2022-01-11T14:29:16.746 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/7a97e214-7287-11ec-8c32-001a4aab830c/ceph-mgr.smithi042.vgdnkh.log: file size changed while zipping 2022-01-11T14:29:49.241 INFO:teuthology.kill:No teuthology processes running 2022-01-11T14:29:50.452 INFO:teuthology.kill:Nuking machines: ['smithi042', 'smithi043'] 2022-01-11T14:29:51.490 INFO:teuthology.kill:2022-01-11 14:29:51,490.490 INFO:teuthology.nuke:targets: 2022-01-11T14:29:51.491 INFO:teuthology.kill: smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFiTkxYlnnVZmxNzBNlKDKa1KmFhRRYS2PZdqPijvvDg29ImoH9LBplowR+Yy+wjZ04aHU/WP9YaNU6h8Y+MI2dHEN94WBLd49HqeLdl1qGBU1OoeO5RhTwAy72Wja2ZGK5W9fP3dazM00MoaWt7OdwEqYwzLcgI459DjVfXxGqGBquD3/tL6Tlp07rV5mJhgn5PKTnym5L+HcBohvXAt+ozDU2JDdD6XPzcpjSEOJQqLe035f4fZCsG0THW5EUE2VI98zFmZOICWDa6fXz4e/9xJ97q/c3B1yXL7q/SFpmc15jPVEDijzu2KTonQHHJzqINxzjy9u9S66lQyLM6yxbhma1gOXJQppGUqK7bhkOiHVbCfc3/VFbNgLFsV99qzTtt+YB64uL40Rd4Flyggg1mXLUrDudas0AtIAmy1t+f+aMiCZOiZS6TJ7t3ruKEDmgekwJShN+HOQLfKSGxSFHGELY8EPXO/v2rvZRyhEXcsrKVHJ2KiEthmtUjGKEeM= 2022-01-11T14:29:51.491 INFO:teuthology.kill: smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDY95n7jXbMizH0+ar4jIANIBAA8fU9pKuxOSD5nrs0DA50bT1Z4/8FAprJdFGpQoShVkythvJ9HUQnjRpIjrVXmDbbN0N+o8rMQWM/8qdTyGPEbtyicDpnEqDPVE5zrjTNUw6Q2eNX6UgHInQobLgSGA8rXK4jDgd+A4i4ESNreC7RT6/gcdOcHKYzWQxhZO0sPGpMjFIEvovM0IyYGXCLfycTjOCSgVgPJP3XDjScyvD8O09whrx9mvApazAFTgBEJ8YK56SXxt6sfmmc+6OTjnKUV/ZHzd7dkIQb+l/8cZKSBxgKBk8PWNrfG+WADUw2+nBxfDHBXbbFVjyISOpJhVdobfh+/UnSNeTuOLHAfr3qqEzDhKZjbJmOsq0IhAwYo2eDzWQ/C5qppRRMmIBCaGhoOFF1jddFDU62ubUxF0E4qvWF/bHarebztAjVfmH1vbUIvMQDgOHHwR2BdtpREBjEhAk1I44nVUij45JP0g6gr7lrDOb/0bHIOJKsvc8= 2022-01-11T14:29:51.520 INFO:teuthology.kill:2022-01-11 14:29:51,519.519 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-11T14:29:51.524 INFO:teuthology.kill:2022-01-11 14:29:51,523.523 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-11T14:29:51.606 INFO:teuthology.kill:2022-01-11 14:29:51,606.606 INFO:teuthology.orchestra.console:Power off smithi042 2022-01-11T14:29:51.620 INFO:teuthology.kill:2022-01-11 14:29:51,619.619 INFO:teuthology.orchestra.console:Power off smithi043 2022-01-11T14:29:59.981 INFO:teuthology.kill:2022-01-11 14:29:59,981.981 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2022-01-11T14:29:59.986 INFO:teuthology.kill:2022-01-11 14:29:59,986.986 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2022-01-11T14:30:00.143 INFO:teuthology.kill:2022-01-11 14:30:00,142.142 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2022-01-11T14:30:00.147 INFO:teuthology.kill:2022-01-11 14:30:00,147.147 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com 2022-01-11T14:32:00.478 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-11T14:32:00.576 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi042 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-11_03:15:03-fs-master-distro-default-smithi/6606813 2022-01-11T14:32:00.577 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi043 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-11_03:15:03-fs-master-distro-default-smithi/6606813