2022-01-11T02:30:07.049 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-11T02:30:07.202 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi106.front.sepia.ceph.com' reimaging 2022-01-11T02:30:07.203 INFO:teuthology.lock.ops:Updating [ubuntu@smithi106.front.sepia.ceph.com]: reset os type and version on server 2022-01-11T02:30:07.203 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2022-01-11T02:30:07.223 INFO:teuthology.lock.ops:Node 'ubuntu@smithi106.front.sepia.ceph.com' reimaging is complete 2022-01-11T02:30:07.224 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging 2022-01-11T02:30:07.224 INFO:teuthology.lock.ops:Updating [ubuntu@smithi145.front.sepia.ceph.com]: reset os type and version on server 2022-01-11T02:30:07.224 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2022-01-11T02:30:07.245 INFO:teuthology.lock.ops:Node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging is complete 2022-01-11T02:30:07.429 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of rhel 8.4 2022-01-11T02:30:07.466 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.4 2022-01-11T02:30:07.801 INFO:teuthology.orchestra.console:Power off smithi106 2022-01-11T02:30:07.877 INFO:teuthology.orchestra.console:Power off smithi145 2022-01-11T02:30:16.170 INFO:teuthology.orchestra.console:Power off for smithi106 completed 2022-01-11T02:30:16.240 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2022-01-11T02:30:16.273 INFO:teuthology.orchestra.console:Power on smithi106 2022-01-11T02:30:16.341 INFO:teuthology.orchestra.console:Power on smithi145 2022-01-11T02:30:20.589 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2022-01-11T02:30:20.690 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2022-01-11T02:30:24.640 INFO:teuthology.orchestra.console:Power on for smithi106 completed 2022-01-11T02:30:24.741 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2022-01-11T02:34:40.459 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-01-11T02:35:14.428 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-11T02:35:14.674 INFO:teuthology.provision.fog.smithi106:Node is ready 2022-01-11T02:35:14.691 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2022-01-11T02:35:14.748 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2022-01-11T02:35:15.073 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2022-01-11T02:35:22.892 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-11T02:35:23.125 INFO:teuthology.provision.fog.smithi145:Node is ready 2022-01-11T02:35:23.141 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2022-01-11T02:35:23.197 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2022-01-11T02:35:23.522 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2022-01-11T02:35:23.673 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2022-01-11T02:35:23.674 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-11T02:35:23.693 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2022-01-11T02:35:23.693 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-11T02:35:23.712 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2022-01-11T02:35:23.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2022-01-11T02:35:23.945 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2022-01-11T02:35:24.000 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Red Hat Enterprise Linux" 2022-01-11T02:35:24.000 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8.4 (Ootpa)" 2022-01-11T02:35:24.000 INFO:teuthology.orchestra.run.smithi106.stdout:ID="rhel" 2022-01-11T02:35:24.001 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="fedora" 2022-01-11T02:35:24.001 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8.4" 2022-01-11T02:35:24.001 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2022-01-11T02:35:24.001 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-11T02:35:24.002 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2022-01-11T02:35:24.002 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-11T02:35:24.002 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.redhat.com/" 2022-01-11T02:35:24.002 INFO:teuthology.orchestra.run.smithi106.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-11T02:35:24.002 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-11T02:35:24.003 INFO:teuthology.orchestra.run.smithi106.stdout: 2022-01-11T02:35:24.003 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-11T02:35:24.003 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-11T02:35:24.003 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-11T02:35:24.004 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-11T02:35:24.005 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2022-01-11T02:35:24.022 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2022-01-11T02:35:24.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2022-01-11T02:35:24.210 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2022-01-11T02:35:24.264 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2022-01-11T02:35:24.264 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.4 (Ootpa)" 2022-01-11T02:35:24.265 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2022-01-11T02:35:24.265 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2022-01-11T02:35:24.265 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.4" 2022-01-11T02:35:24.265 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2022-01-11T02:35:24.265 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-11T02:35:24.266 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2022-01-11T02:35:24.266 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-11T02:35:24.266 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2022-01-11T02:35:24.266 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-11T02:35:24.267 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-11T02:35:24.267 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-11T02:35:24.267 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-11T02:35:24.267 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-11T02:35:24.267 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-11T02:35:24.268 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-11T02:35:24.268 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2022-01-11T02:35:24.371 INFO:teuthology.dispatcher.supervisor:Running job 6606607 2022-01-11T02:35:24.371 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606607 --name yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606607/orig.config.yaml 2022-01-11T02:35:24.375 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606607 2022-01-11T02:35:24.376 INFO:teuthology.dispatcher.supervisor:Job PID: 28347 2022-01-11T02:35:24.376 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-11T14:35:44.961 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-11T14:35:45.122 INFO:teuthology.kill:Killing Pids: {28347} 2022-01-11T14:35:46.260 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-11T14:35:46.261 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-11T14:35:46.261 INFO:teuthology.misc:Compressing logs... 2022-01-11T14:35:46.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2022-01-11T14:35:46.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2022-01-11T14:35:46.491 INFO:teuthology.orchestra.run.smithi106.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-11T14:35:46.720 INFO:teuthology.orchestra.run.smithi145.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-11T14:35:46.849 INFO:teuthology.orchestra.run.smithi106.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-11T14:35:46.850 INFO:teuthology.orchestra.run.smithi106.stderr:tar: Error is not recoverable: exiting now 2022-01-11T14:35:46.913 INFO:teuthology.orchestra.run.smithi145.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-11T14:35:46.913 INFO:teuthology.orchestra.run.smithi145.stderr:tar: Error is not recoverable: exiting now 2022-01-11T14:35:46.915 INFO:teuthology.misc:Compressing logs... 2022-01-11T14:35:47.192 INFO:teuthology.misc:Compressing logs... 2022-01-11T14:35:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-mgr.smithi106.vdwbdu.log: file size changed while zipping 2022-01-11T14:36:03.820 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-11T14:36:04.327 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-11T14:36:17.618 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-11T14:36:20.813 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-mon.smithi106.log: file size changed while zipping 2022-01-11T14:36:34.296 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-11T14:36:34.553 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-11T14:36:41.059 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-mon.smithi145.log: file size changed while zipping 2022-01-11T14:36:49.158 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-11T14:36:54.872 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-11T14:37:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/97ce92e6-7288-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-11T14:37:38.317 INFO:teuthology.kill:No teuthology processes running 2022-01-11T14:37:39.491 INFO:teuthology.kill:Nuking machines: ['smithi106', 'smithi145'] 2022-01-11T14:37:40.478 INFO:teuthology.kill:2022-01-11 14:37:40,478.478 INFO:teuthology.nuke:targets: 2022-01-11T14:37:40.479 INFO:teuthology.kill: smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD2SwoFvjbWu0eqCEwU36Rb7VRt4p3TVFKdcPK/fnc5Y0TuUv+cAjHvo1zRORgqewA4CH/2wZZrtBspUVhqDXkY0occtJWsJoUUUISP9LnyGR4Um0X1wkhSgtUO9LjKs7O3O6Q0dISex9Xm/NOLqFWKJsd7JwFjymuVYuGrpietJ/BmZ/XBb55AS9bRci53WZHlxUZbdAObjgTxV+0onp7sxVWnhzXchiRTyafMFxSj8Mx32JEAW/S9waGqsmcarPnJVODwxkwMfoTE3eEQALDuwXSBuAltj7sgkJrrz5v7bpSJpHye805rxZoMX9cBVYHAY8A4fIdLATnPfvI1R/z+NgZ6Jt00xnxfFpRpXskFB6ZQx3o10gK/2GoIK2+UIU0JQ7+eFeZw46hP7NIJdc3g2KLUSUj3P0crbVv3KDcrs464404bDOefS7rnhKvI0u4qhKFhimdUcxuaUsYhQkwpvc6lmmVroiOr/OBPbW/oa8jOedSkObEDqWDZANRxP5U= 2022-01-11T14:37:40.479 INFO:teuthology.kill: smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCitzFrXndbdnRRCLnKYIVFryjrY341vh4mi8txCFtpeS42quFgRs3Tss+LoCeHUtD71gYHy9QWANXvjg2rjr2MlsFVrHFfnWKe9Is3IxI03ZZZDxuioK7b62nnHQBO/zJBzXk0Ls/I55Gq3vrDtpGRUrtqVQCn528uOQ+RN2Y8e/03hPfK0TMBylfEinJp2sWDYGs97JkicpbXST9kaYmVFKYprKr1Gw60uuh/8/oTtmemcnkeDV4WKXf8UFnMIar5roTiDMG+iQlgyDpi36POF03yhSf/lb2watRHbakNWIhWowvuldiJv/PAiuyYEuIrTzRCLIOpNQx74DZ8hMMeh4llF6QYPpjg/TUMUH75PojEqnPL8whPpTVZgWdwvZLieVetAxVTSpNEuPGU4EyyclBFq2lKWxXXzzw+YJeVjQhcbQDlLx4XiDXAuhtXjU1FgYPpUBdGFZBsgZde8Z/wIm1DvopoKRQyS1Xoy5ZVCGv5Iim/Oh/QnCxBhIWE3Ds= 2022-01-11T14:37:40.506 INFO:teuthology.kill:2022-01-11 14:37:40,506.506 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-11T14:37:40.509 INFO:teuthology.kill:2022-01-11 14:37:40,509.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-11T14:37:40.592 INFO:teuthology.kill:2022-01-11 14:37:40,591.591 INFO:teuthology.orchestra.console:Power off smithi145 2022-01-11T14:37:40.629 INFO:teuthology.kill:2022-01-11 14:37:40,629.629 INFO:teuthology.orchestra.console:Power off smithi106 2022-01-11T14:37:48.964 INFO:teuthology.kill:2022-01-11 14:37:48,964.964 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2022-01-11T14:37:48.994 INFO:teuthology.kill:2022-01-11 14:37:48,994.994 INFO:teuthology.orchestra.console:Power off for smithi106 completed 2022-01-11T14:37:49.114 INFO:teuthology.kill:2022-01-11 14:37:49,113.113 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com 2022-01-11T14:37:49.139 INFO:teuthology.kill:2022-01-11 14:37:49,139.139 INFO:teuthology.lock.ops:unlocked: smithi106.front.sepia.ceph.com 2022-01-11T14:39:49.477 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-11T14:39:49.611 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi106 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-11_03:15:03-fs-master-distro-default-smithi/6606824 2022-01-11T14:39:49.611 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi145 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-11_03:15:03-fs-master-distro-default-smithi/6606824