2022-02-14T17:28:50.939 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-14T17:28:51.095 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging 2022-02-14T17:28:51.096 INFO:teuthology.lock.ops:Updating [ubuntu@smithi131.front.sepia.ceph.com]: reset os type and version on server 2022-02-14T17:28:51.097 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2022-02-14T17:28:51.114 INFO:teuthology.lock.ops:Node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging is complete 2022-02-14T17:28:51.115 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi179.front.sepia.ceph.com' reimaging 2022-02-14T17:28:51.115 INFO:teuthology.lock.ops:Updating [ubuntu@smithi179.front.sepia.ceph.com]: reset os type and version on server 2022-02-14T17:28:51.116 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2022-02-14T17:28:51.134 INFO:teuthology.lock.ops:Node 'ubuntu@smithi179.front.sepia.ceph.com' reimaging is complete 2022-02-14T17:28:51.134 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi204.front.sepia.ceph.com' reimaging 2022-02-14T17:28:51.134 INFO:teuthology.lock.ops:Updating [ubuntu@smithi204.front.sepia.ceph.com]: reset os type and version on server 2022-02-14T17:28:51.135 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2022-02-14T17:28:51.152 INFO:teuthology.lock.ops:Node 'ubuntu@smithi204.front.sepia.ceph.com' reimaging is complete 2022-02-14T17:28:51.336 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream 2022-02-14T17:28:51.344 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.stream 2022-02-14T17:28:51.365 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 8.stream 2022-02-14T17:28:51.653 INFO:teuthology.orchestra.console:Power off smithi131 2022-02-14T17:28:51.672 INFO:teuthology.orchestra.console:Power off smithi179 2022-02-14T17:28:51.708 INFO:teuthology.orchestra.console:Power off smithi204 2022-02-14T17:28:51.818 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2022-02-14T17:28:51.819 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2022-02-14T17:28:51.850 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2022-02-14T17:28:51.920 INFO:teuthology.orchestra.console:Power on smithi179 2022-02-14T17:28:51.928 INFO:teuthology.orchestra.console:Power on smithi131 2022-02-14T17:28:51.951 INFO:teuthology.orchestra.console:Power on smithi204 2022-02-14T17:28:56.182 INFO:teuthology.orchestra.console:Power on for smithi179 completed 2022-02-14T17:28:56.203 INFO:teuthology.orchestra.console:Power on for smithi204 completed 2022-02-14T17:28:56.284 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2022-02-14T17:28:56.305 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2022-02-14T17:29:00.301 INFO:teuthology.orchestra.console:Power on for smithi131 completed 2022-02-14T17:29:00.402 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2022-02-14T17:33:32.040 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-14T17:33:32.323 INFO:teuthology.provision.fog.smithi131:Node is ready 2022-02-14T17:33:32.341 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2022-02-14T17:33:32.400 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2022-02-14T17:33:32.747 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2022-02-14T17:33:33.881 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-14T17:33:34.115 INFO:teuthology.provision.fog.smithi179:Node is ready 2022-02-14T17:33:34.174 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2022-02-14T17:33:34.233 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2022-02-14T17:33:34.580 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2022-02-14T17:33:42.900 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-14T17:33:43.139 INFO:teuthology.provision.fog.smithi204:Node is ready 2022-02-14T17:33:43.197 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2022-02-14T17:33:43.256 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2022-02-14T17:33:43.601 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2022-02-14T17:33:43.806 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2022-02-14T17:33:43.807 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-14T17:33:43.827 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2022-02-14T17:33:43.827 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-14T17:33:43.845 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2022-02-14T17:33:43.845 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-14T17:33:43.892 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2022-02-14T17:33:43.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2022-02-14T17:33:44.139 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2022-02-14T17:33:44.197 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2022-02-14T17:33:44.198 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2022-02-14T17:33:44.198 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2022-02-14T17:33:44.198 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2022-02-14T17:33:44.199 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2022-02-14T17:33:44.199 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2022-02-14T17:33:44.199 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-14T17:33:44.199 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2022-02-14T17:33:44.199 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-14T17:33:44.200 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2022-02-14T17:33:44.200 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-14T17:33:44.200 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-14T17:33:44.200 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-14T17:33:44.202 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2022-02-14T17:33:44.229 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2022-02-14T17:33:44.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2022-02-14T17:33:44.421 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2022-02-14T17:33:44.482 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2022-02-14T17:33:44.482 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2022-02-14T17:33:44.483 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2022-02-14T17:33:44.483 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2022-02-14T17:33:44.483 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2022-02-14T17:33:44.483 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2022-02-14T17:33:44.484 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-14T17:33:44.484 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2022-02-14T17:33:44.484 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-14T17:33:44.484 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2022-02-14T17:33:44.485 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-14T17:33:44.485 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-14T17:33:44.485 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-14T17:33:44.486 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2022-02-14T17:33:44.509 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2022-02-14T17:33:44.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2022-02-14T17:33:44.702 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2022-02-14T17:33:44.761 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2022-02-14T17:33:44.761 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8" 2022-02-14T17:33:44.762 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2022-02-14T17:33:44.762 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2022-02-14T17:33:44.763 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8" 2022-02-14T17:33:44.763 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2022-02-14T17:33:44.763 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-14T17:33:44.764 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2022-02-14T17:33:44.764 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-14T17:33:44.764 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2022-02-14T17:33:44.765 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-14T17:33:44.765 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-14T17:33:44.766 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-14T17:33:44.766 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2022-02-14T17:33:44.885 INFO:teuthology.dispatcher.supervisor:Running job 6682166 2022-02-14T17:33:44.885 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-02-14_16:52:17-kcephfs-octopus-testing-default-smithi/6682166 --name yuriw-2022-02-14_16:52:17-kcephfs-octopus-testing-default-smithi --description kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench} -- /home/teuthworker/archive/yuriw-2022-02-14_16:52:17-kcephfs-octopus-testing-default-smithi/6682166/orig.config.yaml 2022-02-14T17:33:44.889 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-02-14_16:52:17-kcephfs-octopus-testing-default-smithi/6682166 2022-02-14T17:33:44.890 INFO:teuthology.dispatcher.supervisor:Job PID: 30440 2022-02-14T17:33:44.890 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-15T00:04:14.471 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-15T00:04:14.940 INFO:teuthology.kill:Killing Pids: {30440} 2022-02-15T00:04:16.189 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-02-15T00:04:16.190 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-02-15T00:04:16.190 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['client.0'] 2022-02-15T00:04:16.191 INFO:teuthology.misc:Compressing logs... 2022-02-15T00:04:16.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2022-02-15T00:04:16.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2022-02-15T00:04:16.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2022-02-15T00:04:17.092 INFO:teuthology.kill:No teuthology processes running 2022-02-15T00:04:18.203 INFO:teuthology.kill:Nuking machines: ['smithi131', 'smithi179', 'smithi204'] 2022-02-15T00:04:19.179 INFO:teuthology.kill:2022-02-15 00:04:19,179.179 INFO:teuthology.nuke:targets: 2022-02-15T00:04:19.180 INFO:teuthology.kill: smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2ojCVlA5S0pQEO6jphC95iswARHC1oWOvMp1n4LTgrmhLDPH3FfofvLmU6qVnWEVDsoxvcZP57SiCYJvqMK4/4Jw0t+wtnDnQau3TpZz2rUXyzBk7Cwl90xPAkDbJoPMrxUvQFPbj5bpiumsbAgk2kvSvfYFJGoE9o3jZ6ZM6Uvo9Vb4L99V9SKMeMugN4e+6VMGpRnMn+KP8jPsBwpeNBzU6V25YKQe2P2Sob+xz61WascEfRLn1+g2cC0jkFy5YyxhPWSdpIdR5GFIxY1uaxtZMnVWXr50YZtja36276xTkLX7tic0bHUtbv9BVaWPnlq76LJUdLY+AZMKZMUYjH7Ry8KYOcA2nffzYnUpGnGEYbm4ysvkzse0QpZa/D8uJzWIFVX///Bg4XJ5YQllPtqiCWwjaJKK+raz7qG4IfnRHTH8X+J6b7wCqcwaWso1bUIZr8sPC2B6UWoTItxWVDGrtGhxiP4+KJCca7g1XO5hu5ThrKXfis6iznsm+XSE= 2022-02-15T00:04:19.180 INFO:teuthology.kill: smithi179.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCcS4ew81rvypLTGbSxY08nVHuCWl6lA57ABDZVO0gF+LVcqS3mJ9WOGAK7nl6EZ029f2iNeVTpkWUujnBofXnCxRGXZL9Z8ZakuyNPebYDoNtcbRTjizJ7AuZucq76aL3cIlQTqG0BKzL+SNG3S+SBcyBdFBN+JGIb09ji8iyelVADVUcN1zokkJGlh0unP/f4WH4jdmynvZYIUZWbk6d5RHMzLODjqFFVPXNp1TWOYfMWRBsIMmG8a+3zw54dqSfSrbEMH+DqgaordgX9PhF1i8Kr+4DIg2En27UyUERUykH57JJnSRGklXMRQI8LI+ZFtxFMbFydLvWc33T2oPHM5VJBW6W4RPPKFjd/ec35DkLhkxrqYxZpd9PI1AXfTUU2BpXJdz4wWFyXTmXwbBZtl8j6Ngbeo7P9SCYHY/cC/37fTQoSz+Y2UWSrPFa1l0RLP+sk72dCOkyEiyCwpMexgiU8RcKoyK34vZ0+JKO+qOvBvxtBbNesUvfaVQR3Gws= 2022-02-15T00:04:19.181 INFO:teuthology.kill: smithi204.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDle5GnqDKCi4XsSqi7wMbr2a0LJRiwd6El41SOmSzg4pckgXUOfhzYxiV62o1bkRFReMwDHK9tNoEGyqBfrAhhf+/0DFqH7QY63+4YGtNZ5NLFERJ8he4uJ6abenikScziZf2UVo9Smo7p+nBjerDM3W4hUVgtqqGhNSNE7L1pexV4/Tcx+7KZtOhKIUUfVRfzRcSput4lxfZBHHIL6BsXgUzaGVadCq4oPY9kd61WlE3OyWIpPU+j/GM1kWQddn3QCvqPvc50+Uu6v7ixS57pkOjHgmbIka3jYeDjrNBgAPyb/w533moyevN/3xZ4Febvjnzejz9XTlWAqpWmY8JZjR3rhmGLRbXb0gBtH1BYR6ToeYi0XD7w8w9wqyhDn8Y71YU2bx2caDgKXfAyA50neGlEUmaMR0G2lqazmqnUpKvSPjgaVhuObZWppzt1XznqSH+K/+JSx9Qh4c9Z/F8T6PRUHSUflMid+5uvZnKKodMcDAKotBx7mlUOabkejbM= 2022-02-15T00:04:19.208 INFO:teuthology.kill:2022-02-15 00:04:19,208.208 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-15T00:04:19.211 INFO:teuthology.kill:2022-02-15 00:04:19,211.211 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-15T00:04:19.213 INFO:teuthology.kill:2022-02-15 00:04:19,213.213 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-15T00:04:19.294 INFO:teuthology.kill:2022-02-15 00:04:19,294.294 INFO:teuthology.orchestra.console:Power off smithi131 2022-02-15T00:04:19.311 INFO:teuthology.kill:2022-02-15 00:04:19,310.310 INFO:teuthology.orchestra.console:Power off smithi204 2022-02-15T00:04:19.325 INFO:teuthology.kill:2022-02-15 00:04:19,325.325 INFO:teuthology.orchestra.console:Power off smithi179 2022-02-15T00:04:31.796 INFO:teuthology.kill:2022-02-15 00:04:31,796.796 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2022-02-15T00:04:31.800 INFO:teuthology.kill:2022-02-15 00:04:31,800.800 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2022-02-15T00:04:31.828 INFO:teuthology.kill:2022-02-15 00:04:31,828.828 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2022-02-15T00:04:31.947 INFO:teuthology.kill:2022-02-15 00:04:31,947.947 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com 2022-02-15T00:04:31.950 INFO:teuthology.kill:2022-02-15 00:04:31,950.950 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2022-02-15T00:04:31.971 INFO:teuthology.kill:2022-02-15 00:04:31,971.971 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com 2022-02-15T00:06:32.286 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-02-15T00:06:32.410 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi131 but it was locked by another job: /home/teuthworker/archive/dis-2022-02-14_23:19:03-rbd-wip-dis-testing-distro-default-smithi/6682772 2022-02-15T00:06:32.411 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi179 but it was locked by another job: /home/teuthworker/archive/dis-2022-02-14_23:19:03-rbd-wip-dis-testing-distro-default-smithi/6682772 2022-02-15T00:06:32.411 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi204 but it was locked by another job: /home/teuthworker/archive/dis-2022-02-14_23:19:03-rbd-wip-dis-testing-distro-default-smithi/6682772