2022-01-15T05:22:23.883 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-15T05:22:24.039 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging 2022-01-15T05:22:24.041 INFO:teuthology.lock.ops:Updating [ubuntu@smithi062.front.sepia.ceph.com]: reset os type and version on server 2022-01-15T05:22:24.041 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2022-01-15T05:22:24.064 INFO:teuthology.lock.ops:Node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging is complete 2022-01-15T05:22:24.065 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi152.front.sepia.ceph.com' reimaging 2022-01-15T05:22:24.065 INFO:teuthology.lock.ops:Updating [ubuntu@smithi152.front.sepia.ceph.com]: reset os type and version on server 2022-01-15T05:22:24.067 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2022-01-15T05:22:24.090 INFO:teuthology.lock.ops:Node 'ubuntu@smithi152.front.sepia.ceph.com' reimaging is complete 2022-01-15T05:22:24.350 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.4 2022-01-15T05:22:24.364 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.4 2022-01-15T05:22:24.793 INFO:teuthology.orchestra.console:Power off smithi152 2022-01-15T05:22:24.810 INFO:teuthology.orchestra.console:Power off smithi062 2022-01-15T05:22:33.170 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2022-01-15T05:22:33.177 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2022-01-15T05:22:33.272 INFO:teuthology.orchestra.console:Power on smithi152 2022-01-15T05:22:33.281 INFO:teuthology.orchestra.console:Power on smithi062 2022-01-15T05:22:41.648 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2022-01-15T05:22:41.750 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2022-01-15T05:22:41.753 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2022-01-15T05:22:41.854 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2022-01-15T05:26:54.169 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-15T05:27:14.200 INFO:teuthology.provision.fog.smithi062:Node is ready 2022-01-15T05:27:14.220 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2022-01-15T05:27:14.278 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2022-01-15T05:27:14.618 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2022-01-15T05:27:46.774 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-15T05:27:46.993 INFO:teuthology.provision.fog.smithi152:Node is ready 2022-01-15T05:27:47.008 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2022-01-15T05:27:47.064 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2022-01-15T05:27:47.400 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2022-01-15T05:27:47.551 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2022-01-15T05:27:47.552 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-15T05:27:47.571 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2022-01-15T05:27:47.572 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-15T05:27:47.590 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2022-01-15T05:27:47.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2022-01-15T05:27:47.835 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2022-01-15T05:27:47.891 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2022-01-15T05:27:47.892 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.4 (Ootpa)" 2022-01-15T05:27:47.892 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2022-01-15T05:27:47.892 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2022-01-15T05:27:47.892 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.4" 2022-01-15T05:27:47.893 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2022-01-15T05:27:47.893 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-15T05:27:47.893 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2022-01-15T05:27:47.893 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-15T05:27:47.894 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2022-01-15T05:27:47.894 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-15T05:27:47.894 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-15T05:27:47.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-01-15T05:27:47.894 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-15T05:27:47.895 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-15T05:27:47.895 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-15T05:27:47.895 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-15T05:27:47.897 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2022-01-15T05:27:47.924 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2022-01-15T05:27:47.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2022-01-15T05:27:48.122 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2022-01-15T05:27:48.177 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2022-01-15T05:27:48.178 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.4 (Ootpa)" 2022-01-15T05:27:48.178 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2022-01-15T05:27:48.178 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2022-01-15T05:27:48.178 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.4" 2022-01-15T05:27:48.179 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2022-01-15T05:27:48.179 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-15T05:27:48.179 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2022-01-15T05:27:48.179 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-15T05:27:48.179 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2022-01-15T05:27:48.180 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-15T05:27:48.180 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-15T05:27:48.180 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-01-15T05:27:48.180 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-15T05:27:48.181 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-15T05:27:48.181 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-15T05:27:48.181 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-15T05:27:48.182 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2022-01-15T05:27:48.309 INFO:teuthology.dispatcher.supervisor:Running job 6618086 2022-01-15T05:27:48.309 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6618086 --name yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6618086/orig.config.yaml 2022-01-15T05:27:48.313 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-14_23:22:09-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6618086 2022-01-15T05:27:48.314 INFO:teuthology.dispatcher.supervisor:Job PID: 30197 2022-01-15T05:27:48.314 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-15T11:57:59.751 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-15T11:57:59.928 INFO:teuthology.kill:Killing Pids: {30197} 2022-01-15T11:58:01.139 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-15T11:58:01.140 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-15T11:58:01.140 INFO:teuthology.misc:Compressing logs... 2022-01-15T11:58:01.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2022-01-15T11:58:01.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2022-01-15T11:58:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-15T11:58:01.610 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-15T11:58:01.647 INFO:teuthology.orchestra.run.smithi062.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-15T11:58:01.648 INFO:teuthology.orchestra.run.smithi062.stderr:tar: Error is not recoverable: exiting now 2022-01-15T11:58:01.703 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-15T11:58:01.704 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2022-01-15T11:58:01.705 INFO:teuthology.misc:Compressing logs... 2022-01-15T11:58:01.882 INFO:teuthology.misc:Compressing logs... 2022-01-15T11:58:09.711 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-15T11:58:11.259 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-15T11:58:11.589 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-mgr.smithi062.xbimbe.log: file size changed while zipping 2022-01-15T11:58:14.900 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-mon.smithi152.log: file size changed while zipping 2022-01-15T11:58:19.375 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-15T11:58:22.116 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-15T11:58:27.993 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-15T11:58:31.334 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-15T11:58:38.332 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-15T11:58:38.903 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-15T11:58:48.145 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/68268e96-75c5-11ec-8c32-001a4aab830c/ceph-mon.smithi062.log: file size changed while zipping 2022-01-15T11:59:05.339 INFO:teuthology.kill:No teuthology processes running 2022-01-15T11:59:06.504 INFO:teuthology.kill:Nuking machines: ['smithi062', 'smithi152'] 2022-01-15T11:59:07.636 INFO:teuthology.kill:2022-01-15 11:59:07,636.636 INFO:teuthology.nuke:targets: 2022-01-15T11:59:07.637 INFO:teuthology.kill: smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3vOBQk+Z5kyVsJSU5js29PvERtsyGUPiQYiDEiHAnWBDayiPNxsWao6hPc/5FfoNH8ivkDEyyGlXifXydgYdQ09HL40CjxWS2V5onmGJdY5oTCQoPlPGKqCcW8ExRJOxE12VDLaN21rD4XtvZ3O9SPtyBc3GL4ASkiNBxBV3+MkKcjDENiCu5eB2qSBcC8QnWSA9rkffYR79V+aDsLpKAnzZSZvFRTiG1kFT1wrVEV6xNWd/ZbqTQNjG2PpEQ3BqyfgTrUYjEH9nYDClaCwPzMYVjNsCpJG96gFh78kccLHsG/diOB+4aYFhH/mA3Wdp/U7xxKhwpFYmm1ELlPVpHJbvN5vpt48bOI27YOcQ+DSKj7IYih0c/UlBNKg6jNJ65QQrzuZorhLSYdKbOELkkthT/+rGNgtMySPdTipE7ezOV02ZRHuIrLC7+8iIMB/+MY28FSRQ1BW0OZamXIrOZLH8RMIXuoIXz9H9dtnr6lCmB7Tw07ejvESaPPJm8NiU= 2022-01-15T11:59:07.637 INFO:teuthology.kill: smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCz1Sr7ho4NDphhd1ckiifq1HM2glsVhKSl5GD8mWFPEKpVohJ5JKu6KCN60Ltvvc7fBPgB8JpgFGeWTyl185gB4OFSj13IFFfDfOUJkTGMvEBbfeYFbHyaktffXyfuEd46FHNcuVZcat5KHXmQlxbO79/IDZrAcKMbRtm4jeQzzi9TnipWH/b9xVJ2RiUkpF13BqvdugIBjyqHCd+Z/5WV/kqGqWWZ1uZkdNhHFEnw/eve2ph0yK32BnZ+XljhISAxNcOlrCsP12Tkf5bN1t76DFxk3tXed/YFHktNaTC5rZIHpI+2FCbbOVOoLdyiaLrOXR+fZStc07LRbR/AZqh2RU/MZita+EJ2dkkpescxDj+zWVMqAG3cqsdxmabQ0zFvWLm/54HuTdre1ZpZO+ld+Z02OxP3WVJrh2j/SteBm31lTV6QrtYDCSMaUUwDK1yVFy+732PBq/TcgMrxxX/GygCajzGa3Sm1Zk/Bduj0c4hT6uGvVQMtv8IXnT4tV/0= 2022-01-15T11:59:07.667 INFO:teuthology.kill:2022-01-15 11:59:07,667.667 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-15T11:59:07.672 INFO:teuthology.kill:2022-01-15 11:59:07,672.672 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-15T11:59:07.761 INFO:teuthology.kill:2022-01-15 11:59:07,760.760 INFO:teuthology.orchestra.console:Power off smithi062 2022-01-15T11:59:07.776 INFO:teuthology.kill:2022-01-15 11:59:07,776.776 INFO:teuthology.orchestra.console:Power off smithi152 2022-01-15T11:59:16.138 INFO:teuthology.kill:2022-01-15 11:59:16,137.137 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2022-01-15T11:59:16.143 INFO:teuthology.kill:2022-01-15 11:59:16,143.143 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2022-01-15T11:59:16.295 INFO:teuthology.kill:2022-01-15 11:59:16,294.294 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2022-01-15T11:59:16.298 INFO:teuthology.kill:2022-01-15 11:59:16,298.298 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2022-01-15T12:01:16.624 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-15T12:01:16.719 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619414 2022-01-15T12:01:16.720 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi152 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-15_05:47:18-rados-wip-yuri8-testing-2022-01-14-1551-distro-default-smithi/6619414