2022-01-20T13:36:03.806 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-20T13:36:03.940 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging 2022-01-20T13:36:03.941 INFO:teuthology.lock.ops:Updating [ubuntu@smithi136.front.sepia.ceph.com]: reset os type and version on server 2022-01-20T13:36:03.941 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2022-01-20T13:36:03.962 INFO:teuthology.lock.ops:Node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging is complete 2022-01-20T13:36:03.962 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging 2022-01-20T13:36:03.962 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server 2022-01-20T13:36:03.963 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-01-20T13:36:03.982 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete 2022-01-20T13:36:04.195 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of rhel 8.4 2022-01-20T13:36:04.204 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.4 2022-01-20T13:36:04.559 INFO:teuthology.orchestra.console:Power off smithi136 2022-01-20T13:36:04.575 INFO:teuthology.orchestra.console:Power off smithi142 2022-01-20T13:36:17.057 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2022-01-20T13:36:17.063 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2022-01-20T13:36:17.158 INFO:teuthology.orchestra.console:Power on smithi136 2022-01-20T13:36:17.168 INFO:teuthology.orchestra.console:Power on smithi142 2022-01-20T13:36:21.412 INFO:teuthology.orchestra.console:Power on for smithi136 completed 2022-01-20T13:36:21.418 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2022-01-20T13:36:21.514 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2022-01-20T13:36:21.519 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2022-01-20T13:40:30.887 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-20T13:40:51.518 INFO:teuthology.provision.fog.smithi136:Node is ready 2022-01-20T13:40:51.538 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2022-01-20T13:40:51.594 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2022-01-20T13:40:51.926 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2022-01-20T13:41:09.094 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-20T13:41:09.291 INFO:teuthology.provision.fog.smithi142:Node is ready 2022-01-20T13:41:09.347 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2022-01-20T13:41:09.403 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2022-01-20T13:41:09.726 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2022-01-20T13:41:09.871 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2022-01-20T13:41:09.872 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-20T13:41:09.891 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2022-01-20T13:41:09.892 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-20T13:41:09.910 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2022-01-20T13:41:09.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2022-01-20T13:41:10.144 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2022-01-20T13:41:10.201 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2022-01-20T13:41:10.201 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.4 (Ootpa)" 2022-01-20T13:41:10.201 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2022-01-20T13:41:10.201 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2022-01-20T13:41:10.202 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.4" 2022-01-20T13:41:10.202 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2022-01-20T13:41:10.202 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-20T13:41:10.202 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2022-01-20T13:41:10.203 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-20T13:41:10.203 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2022-01-20T13:41:10.203 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-20T13:41:10.203 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-20T13:41:10.204 INFO:teuthology.orchestra.run.smithi136.stdout: 2022-01-20T13:41:10.204 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-20T13:41:10.204 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-20T13:41:10.204 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-20T13:41:10.204 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-20T13:41:10.206 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2022-01-20T13:41:10.228 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2022-01-20T13:41:10.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-01-20T13:41:10.450 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2022-01-20T13:41:10.504 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2022-01-20T13:41:10.505 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.4 (Ootpa)" 2022-01-20T13:41:10.505 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2022-01-20T13:41:10.505 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2022-01-20T13:41:10.506 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.4" 2022-01-20T13:41:10.506 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2022-01-20T13:41:10.506 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-20T13:41:10.506 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2022-01-20T13:41:10.507 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-20T13:41:10.507 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2022-01-20T13:41:10.507 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-20T13:41:10.507 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-20T13:41:10.508 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-20T13:41:10.508 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-20T13:41:10.508 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-20T13:41:10.508 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-20T13:41:10.508 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-20T13:41:10.509 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-01-20T13:41:10.607 INFO:teuthology.dispatcher.supervisor:Running job 6624048 2022-01-20T13:41:10.607 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_ifed01@teuthology --archive /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6624048 --name ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6624048/orig.config.yaml 2022-01-20T13:41:10.612 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6624048 2022-01-20T13:41:10.613 INFO:teuthology.dispatcher.supervisor:Job PID: 6209 2022-01-20T13:41:10.614 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-20T20:11:39.879 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-20T20:11:40.073 INFO:teuthology.kill:Killing Pids: {6209} 2022-01-20T20:11:41.398 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-20T20:11:41.400 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-20T20:11:41.400 INFO:teuthology.misc:Compressing logs... 2022-01-20T20:11:41.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2022-01-20T20:11:41.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-01-20T20:11:41.670 INFO:teuthology.orchestra.run.smithi136.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-20T20:11:41.908 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-20T20:11:41.940 INFO:teuthology.orchestra.run.smithi136.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-20T20:11:41.940 INFO:teuthology.orchestra.run.smithi136.stderr:tar: Error is not recoverable: exiting now 2022-01-20T20:11:41.976 INFO:teuthology.orchestra.run.smithi142.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-20T20:11:41.976 INFO:teuthology.orchestra.run.smithi142.stderr:tar: Error is not recoverable: exiting now 2022-01-20T20:11:41.977 INFO:teuthology.misc:Compressing logs... 2022-01-20T20:11:42.197 INFO:teuthology.misc:Compressing logs... 2022-01-20T20:11:57.033 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-20T20:11:59.144 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-mgr.smithi136.goqsrr.log: file size changed while zipping 2022-01-20T20:12:02.584 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-20T20:12:05.761 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-mon.smithi142.log: file size changed while zipping 2022-01-20T20:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-20T20:12:16.353 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-20T20:12:25.396 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-mon.smithi136.log: file size changed while zipping 2022-01-20T20:12:31.375 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-20T20:12:40.454 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-20T20:12:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-20T20:12:59.696 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/1bc6142c-79f8-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-20T20:13:31.684 INFO:teuthology.kill:No teuthology processes running 2022-01-20T20:13:33.063 INFO:teuthology.kill:Nuking machines: ['smithi136', 'smithi142'] 2022-01-20T20:13:34.179 INFO:teuthology.kill:2022-01-20 20:13:34,179.179 INFO:teuthology.nuke:targets: 2022-01-20T20:13:34.180 INFO:teuthology.kill: smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6+01CnZuIVAkGHWud1jPgZx8UI7d/mxJL3TaG9tJAyQVA+p+s8tSgj2x2qdu+5yNSjOXtmCzf8GRPc1pWhY39BLZ8sA5S+xbMVt68XiYiO+Iq11MCXlY/n18cd6eyQrMeNbkaCtR0QIc+qyLgah1QWWekOnalPJMFE9SHMAma5PWwYqDPItbjpULzRwKoLdGEi7IJMb5UIzVvuYBhHkNb7PKcuMRE7fZ9/9n3Rqh9wPaCR12mtjmTApIixcZHm08VIm9Ui7PIqNBQ9uYkqkHDBVk/z4rFCbnPLbD3ccWNG8iSPp/1620OU4gA1WxhNR15NS3H/i49d50kvApE5xI8elxCxf68WjSYtE8FPmjEQm8Z5chI3FrOK07HLAEfE00e2/gLjRO+KTAyjAAY1LUfo1slt7hje3sy9yLuAZe5ddSs5HTDoRKk8ghJxPtyKSE9VzQuVMxV3Tl2HN80J9SKtAJV8335i4c2j6U0QRv654tj14R618rQXuFoKF/EyC0= 2022-01-20T20:13:34.181 INFO:teuthology.kill: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDjbEajd/lcMdlZ1TMEycbXLLB+zi8e9SmicGBrpcysa5/p6ODTduyeVdQpoCE/NCFsJfLrW9LY2LbAaMiIow8eMFmndvhk5ATzoOKAxhPg/pQa5w/vZimbTFwmBhbiO+JFWEBpY1HxdZmHpZMMsG1bxvGI+yIyhyvkBJMR0bbX5xhxe2DLVOaxPHhwYj9lWQNgkRQDpM0rV6fH5hJ+k/sCnTphAtr9rc8g3uwgv7iKlN5qUi1r7WT34RM856tnd05h4DKWYCAi/VAiVWLybDQm0suZ3DpiloPnDcj9T/UtB4OoDAzfo8WIug7ftEaAkPYSc4R4/hDRW10TPpBlGKoJANHuU8sU12RPwjWCGSHby/0897oVVc+sddkOyQdkIgJXzrkPFdAaDbyn2MvYcIrgK+jTnFMsz+hB3guDkpk9XOGSPjicct1JIsN75i/RZJ49j7FNjqMvoEQcs2WDMcOmo4o0+9mAscTVMeHpSq2/EEiYM+ezU4//HEnpqOXLRc= 2022-01-20T20:13:34.217 INFO:teuthology.kill:2022-01-20 20:13:34,217.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-20T20:13:34.224 INFO:teuthology.kill:2022-01-20 20:13:34,224.224 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-20T20:13:34.355 INFO:teuthology.kill:2022-01-20 20:13:34,355.355 INFO:teuthology.orchestra.console:Power off smithi136 2022-01-20T20:13:34.371 INFO:teuthology.kill:2022-01-20 20:13:34,371.371 INFO:teuthology.orchestra.console:Power off smithi142 2022-01-20T20:13:46.871 INFO:teuthology.kill:2022-01-20 20:13:46,870.870 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2022-01-20T20:13:46.885 INFO:teuthology.kill:2022-01-20 20:13:46,885.885 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2022-01-20T20:13:47.021 INFO:teuthology.kill:2022-01-20 20:13:47,020.020 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com 2022-01-20T20:13:47.034 INFO:teuthology.kill:2022-01-20 20:13:47,034.034 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2022-01-20T20:15:47.388 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-20T20:15:47.507 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi136 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-20_17:34:11-fs-wip-yuri5-testing-2022-01-20-0652-pacific-distro-default-smithi/6629452 2022-01-20T20:15:47.507 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-20_17:34:11-fs-wip-yuri5-testing-2022-01-20-0652-pacific-distro-default-smithi/6629452