2022-04-05T03:25:09.894 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-05T03:25:10.008 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging 2022-04-05T03:25:10.009 INFO:teuthology.lock.ops:Updating [ubuntu@smithi008.front.sepia.ceph.com]: reset os type and version on server 2022-04-05T03:25:10.010 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2022-04-05T03:25:10.027 INFO:teuthology.lock.ops:Node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging is complete 2022-04-05T03:25:10.027 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging 2022-04-05T03:25:10.027 INFO:teuthology.lock.ops:Updating [ubuntu@smithi160.front.sepia.ceph.com]: reset os type and version on server 2022-04-05T03:25:10.028 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2022-04-05T03:25:10.046 INFO:teuthology.lock.ops:Node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging is complete 2022-04-05T03:25:10.231 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.4 2022-04-05T03:25:10.259 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of rhel 8.4 2022-04-05T03:25:10.592 INFO:teuthology.orchestra.console:Power off smithi008 2022-04-05T03:25:10.611 INFO:teuthology.orchestra.console:Power off smithi160 2022-04-05T03:25:10.749 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2022-04-05T03:25:10.850 INFO:teuthology.orchestra.console:Power on smithi160 2022-04-05T03:25:18.965 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2022-04-05T03:25:19.066 INFO:teuthology.orchestra.console:Power on smithi008 2022-04-05T03:25:19.293 INFO:teuthology.orchestra.console:Power on for smithi160 completed 2022-04-05T03:25:19.394 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2022-04-05T03:25:27.432 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2022-04-05T03:25:27.533 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2022-04-05T03:29:56.619 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-05T03:29:56.852 INFO:teuthology.provision.fog.smithi008:Node is ready 2022-04-05T03:29:56.868 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2022-04-05T03:29:56.923 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2022-04-05T03:29:57.243 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2022-04-05T03:30:12.452 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-05T03:30:12.705 INFO:teuthology.provision.fog.smithi160:Node is ready 2022-04-05T03:30:12.720 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2022-04-05T03:30:12.775 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2022-04-05T03:30:13.106 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2022-04-05T03:30:13.279 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2022-04-05T03:30:13.280 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-05T03:30:13.299 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2022-04-05T03:30:13.299 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-05T03:30:13.316 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2022-04-05T03:30:13.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2022-04-05T03:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2022-04-05T03:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2022-04-05T03:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.4 (Ootpa)" 2022-04-05T03:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2022-04-05T03:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2022-04-05T03:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.4" 2022-04-05T03:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2022-04-05T03:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-04-05T03:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2022-04-05T03:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-04-05T03:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2022-04-05T03:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-04-05T03:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-05T03:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-04-05T03:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-05T03:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-04-05T03:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-04-05T03:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-04-05T03:30:13.615 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2022-04-05T03:30:13.634 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2022-04-05T03:30:13.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2022-04-05T03:30:13.857 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2022-04-05T03:30:13.911 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2022-04-05T03:30:13.911 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.4 (Ootpa)" 2022-04-05T03:30:13.912 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2022-04-05T03:30:13.912 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2022-04-05T03:30:13.912 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.4" 2022-04-05T03:30:13.913 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2022-04-05T03:30:13.913 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-04-05T03:30:13.913 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2022-04-05T03:30:13.913 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-04-05T03:30:13.913 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2022-04-05T03:30:13.914 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-04-05T03:30:13.914 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-05T03:30:13.914 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-04-05T03:30:13.914 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-05T03:30:13.914 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-04-05T03:30:13.915 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-04-05T03:30:13.915 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-04-05T03:30:13.915 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2022-04-05T03:30:13.998 INFO:teuthology.dispatcher.supervisor:Running job 6775887 2022-04-05T03:30:13.998 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775887 --name teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi --description rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/big-cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} -- /home/teuthworker/archive/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775887/orig.config.yaml 2022-04-05T03:30:14.002 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-04-04_02:01:03-rbd-quincy-distro-default-smithi/6775887 2022-04-05T03:30:14.002 INFO:teuthology.dispatcher.supervisor:Job PID: 27583 2022-04-05T03:30:14.003 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-05T10:00:42.285 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-05T10:00:42.444 INFO:teuthology.kill:Killing Pids: {27583} 2022-04-05T10:00:43.745 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1'] 2022-04-05T10:00:43.746 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0'] 2022-04-05T10:00:43.747 INFO:teuthology.misc:Compressing logs... 2022-04-05T10:00:43.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2022-04-05T10:00:43.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2022-04-05T10:00:44.453 INFO:teuthology.misc:Compressing logs... 2022-04-05T10:00:44.608 INFO:teuthology.misc:Compressing logs... 2022-04-05T10:02:50.899 INFO:teuthology.kill:No teuthology processes running 2022-04-05T10:02:52.054 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi160'] 2022-04-05T10:02:53.001 INFO:teuthology.kill:2022-04-05 10:02:53,000.000 INFO:teuthology.nuke:targets: 2022-04-05T10:02:53.002 INFO:teuthology.kill: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD41RHpBmbGJu/RFDOc8SjRUeg3s5Dg18dVIsx9dCHVLRlRLfvrNjXforSNrc4VziHLsi/wXbF54Jq7dVm4RP/DsytUeaxNAhhzkGRbJQx9WVmTacKzKSoNtRUzBOymmBBNUiAIY5mS0CkfmKU+olJkuvFjq/0WWb/xf05Run7eCgte5BrAyshjsgYZsxN3+39/E8rv4+BOtnnnQiriVL18cYBoAnY7s4jEvP69qouqnP/zWJ+OmRz2BAMLWztsWDuB8HYIo/J+O48bfCj5I/GlbshyF3OzFN7bGO76XMzGgGrF4Oe3lLXZUMtFMoe6rKdh3L5bgcuckzO7NzAqc/KPH1/DH6LjBERMN+f+/r75tmqZDLDNtDndD99OWePtOIoePXLIbkHXaQJp4eeVgdFqiY2pGtRGscJdkmrUn0oq5OF3Z2X2zy+qWHOF2bR9FEB6dddXc9U7/re0Kp4e9ZJG+wS3SumOD6/qYpMrLGocJKn0q6GVeMc3G5i707G/qy0= 2022-04-05T10:02:53.002 INFO:teuthology.kill: smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCm5Rk7KQAcIFze+pbdt9YcPNIDVaUmC7UfJ+pIihn3Max4zdjQ/nsd78vTtf+8TkDmXRvtFaNjLtzsPy22rlR3tILsgbPRWNrRXBUVQsSZavbUQLfJ9ED+3swj0M07PyB8Ib87cqO2msnJ2Tli++ZPEMMRLLRj1b/jlAlTE17vCXz+JsYE3M0IIWPN/5oe3XK6Xn8lYj56mewCpzA9n5DauIZd8dAH9wQ2EMWAKeMikqOnqHNcxo/Umu4RZBihxLdL5kFkUEmkgumwgVlguGZpNVFUKb9uThah22uCZjNDUyjV9rsKcpjpW7z1mBM8eVTHrEGsMij63UPm7eGgZxEW/I/jdQTt8DDFRk13nYHS86tGRkZ31YT4L8Qdmt+yoV9bzfI9kx6OE1IwZ7CJ+JYCYVj0W37cFGIBIT1uCfpYWAXh15tf/7mSqrZiq6B7refNl0xTOwJyrtsUw4oUEDrAqVBglgf28fFCtDJuTYZdtJRzRMsMuIHqCtwd+5MZGMU= 2022-04-05T10:02:53.028 INFO:teuthology.kill:2022-04-05 10:02:53,028.028 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-05T10:02:53.031 INFO:teuthology.kill:2022-04-05 10:02:53,031.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-05T10:02:53.106 INFO:teuthology.kill:2022-04-05 10:02:53,106.106 INFO:teuthology.orchestra.console:Power off smithi008 2022-04-05T10:02:53.121 INFO:teuthology.kill:2022-04-05 10:02:53,120.120 INFO:teuthology.orchestra.console:Power off smithi160 2022-04-05T10:03:01.476 INFO:teuthology.kill:2022-04-05 10:03:01,475.475 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2022-04-05T10:03:01.482 INFO:teuthology.kill:2022-04-05 10:03:01,482.482 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2022-04-05T10:03:01.626 INFO:teuthology.kill:2022-04-05 10:03:01,625.625 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com 2022-04-05T10:03:01.628 INFO:teuthology.kill:2022-04-05 10:03:01,628.628 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2022-04-05T10:05:01.930 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-05T10:05:02.012 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-05_04:17:02-fs-pacific-distro-default-smithi/6777487 2022-04-05T10:05:02.012 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi160 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-05_04:17:02-fs-pacific-distro-default-smithi/6777487