2021-11-19T04:39:47.890 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-19T04:39:48.024 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging 2021-11-19T04:39:48.025 INFO:teuthology.lock.ops:Updating [ubuntu@smithi016.front.sepia.ceph.com]: reset os type and version on server 2021-11-19T04:39:48.026 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-11-19T04:39:48.043 INFO:teuthology.lock.ops:Node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging is complete 2021-11-19T04:39:48.044 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging 2021-11-19T04:39:48.044 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server 2021-11-19T04:39:48.045 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2021-11-19T04:39:48.065 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete 2021-11-19T04:39:48.259 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 8.4 2021-11-19T04:39:48.283 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.4 2021-11-19T04:39:48.623 INFO:teuthology.orchestra.console:Power off smithi016 2021-11-19T04:39:48.639 INFO:teuthology.orchestra.console:Power off smithi183 2021-11-19T04:39:48.781 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-11-19T04:39:48.883 INFO:teuthology.orchestra.console:Power on smithi183 2021-11-19T04:39:56.999 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-11-19T04:39:57.102 INFO:teuthology.orchestra.console:Power on smithi016 2021-11-19T04:39:57.244 INFO:teuthology.orchestra.console:Power on for smithi183 completed 2021-11-19T04:39:57.345 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2021-11-19T04:40:05.476 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2021-11-19T04:40:05.577 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2021-11-19T04:44:40.061 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-19T04:44:40.280 INFO:teuthology.provision.fog.smithi016:Node is ready 2021-11-19T04:44:40.296 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2021-11-19T04:44:40.352 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2021-11-19T04:44:40.675 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2021-11-19T04:44:46.865 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-19T04:44:47.073 INFO:teuthology.provision.fog.smithi183:Node is ready 2021-11-19T04:44:47.088 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2021-11-19T04:44:47.144 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2021-11-19T04:44:47.486 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2021-11-19T04:44:47.735 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2021-11-19T04:44:47.736 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-19T04:44:47.760 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2021-11-19T04:44:47.761 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-19T04:44:47.786 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2021-11-19T04:44:47.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2021-11-19T04:44:48.057 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2021-11-19T04:44:48.119 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2021-11-19T04:44:48.119 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.4 (Ootpa)" 2021-11-19T04:44:48.120 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2021-11-19T04:44:48.120 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2021-11-19T04:44:48.120 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.4" 2021-11-19T04:44:48.120 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2021-11-19T04:44:48.121 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-11-19T04:44:48.121 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2021-11-19T04:44:48.121 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-11-19T04:44:48.121 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2021-11-19T04:44:48.121 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-11-19T04:44:48.122 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-11-19T04:44:48.122 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-11-19T04:44:48.122 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-11-19T04:44:48.124 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-11-19T04:44:48.124 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-11-19T04:44:48.124 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-11-19T04:44:48.126 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-11-19T04:44:48.147 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2021-11-19T04:44:48.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2021-11-19T04:44:48.375 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2021-11-19T04:44:48.428 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2021-11-19T04:44:48.429 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.4 (Ootpa)" 2021-11-19T04:44:48.429 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2021-11-19T04:44:48.429 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2021-11-19T04:44:48.430 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.4" 2021-11-19T04:44:48.430 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2021-11-19T04:44:48.430 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-11-19T04:44:48.430 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2021-11-19T04:44:48.431 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-11-19T04:44:48.431 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2021-11-19T04:44:48.431 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-11-19T04:44:48.431 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-11-19T04:44:48.431 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-11-19T04:44:48.432 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-11-19T04:44:48.432 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-11-19T04:44:48.432 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-11-19T04:44:48.432 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-11-19T04:44:48.433 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2021-11-19T04:44:48.527 INFO:teuthology.dispatcher.supervisor:Running job 6512890 2021-11-19T04:44:48.528 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner vshankar --archive /home/teuthworker/archive/vshankar-2021-11-19_04:35:25-fs-wip-kcephfs-new-mount-syntax-20211118-095848-testing-default-smithi/6512890 --name vshankar-2021-11-19_04:35:25-fs-wip-kcephfs-new-mount-syntax-20211118-095848-testing-default-smithi --description fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/vshankar-2021-11-19_04:35:25-fs-wip-kcephfs-new-mount-syntax-20211118-095848-testing-default-smithi/6512890/orig.config.yaml 2021-11-19T04:44:48.532 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2021-11-19_04:35:25-fs-wip-kcephfs-new-mount-syntax-20211118-095848-testing-default-smithi/6512890 2021-11-19T04:44:48.534 INFO:teuthology.dispatcher.supervisor:Job PID: 5798 2021-11-19T04:44:48.535 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-19T16:45:09.353 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-19T16:45:09.941 INFO:teuthology.kill:Killing Pids: {5798} 2021-11-19T16:45:11.150 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-11-19T16:45:11.151 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-11-19T16:45:11.151 INFO:teuthology.misc:Compressing logs... 2021-11-19T16:45:11.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2021-11-19T16:45:11.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2021-11-19T16:45:11.708 INFO:teuthology.misc:Compressing logs... 2021-11-19T16:45:11.747 INFO:teuthology.orchestra.run.smithi016.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2021-11-19T16:45:11.772 INFO:teuthology.orchestra.run.smithi183.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2021-11-19T16:45:11.813 INFO:teuthology.orchestra.run.smithi016.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2021-11-19T16:45:11.813 INFO:teuthology.orchestra.run.smithi016.stderr:tar: Error is not recoverable: exiting now 2021-11-19T16:45:11.839 INFO:teuthology.orchestra.run.smithi183.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2021-11-19T16:45:11.839 INFO:teuthology.orchestra.run.smithi183.stderr:tar: Error is not recoverable: exiting now 2021-11-19T16:45:11.840 INFO:teuthology.misc:Compressing logs... 2021-11-19T16:45:46.503 INFO:teuthology.kill:No teuthology processes running 2021-11-19T16:45:47.640 INFO:teuthology.kill:Nuking machines: ['smithi016', 'smithi183'] 2021-11-19T16:45:48.628 INFO:teuthology.kill:2021-11-19 16:45:48,628.628 INFO:teuthology.nuke:targets: 2021-11-19T16:45:48.629 INFO:teuthology.kill: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnjP8KQxSpAfX/cL/d9P9tGZwfQqoJWkHlycOT63bOy3Odk5QquibpJvmfoCz97nCibY2tIlgtEn0zkgAwgMrXtyAQksS//S2IrYduMRde/a4D5hM+spB3iNV2RbVHzEo/oIpFpzn33P56pYZykZnlCJ0EHwd2Qu2ARDc+wEGrY3qGfGlt7BXQMqa/a5+Mg+t7nEUPWKoOjT2q9CTZunTQNC5/9iefQnZlqzBWwd70aACGSFq3JL5aLvGI444oojmwdwEf7+Fvn9KviHT7GnBzVv+qHdznVOba6zy1ZLg9XhT9pVvZEsw/aHg2BlIr9pAO3n7sNpd5oqcbnEK1jqV0xLPFGAb1Md6nuTJksSxVDnhOcmeUuJEbG9u36GU5h73lUgNxl6rJgPOIK0ULq5DeYjppxnRY82Z/1XnUcQGxBbHhupulIHtfaf53J2TeXfU9wTPLiO2ppWnAFK0H6P9FTO6HbEKO4Td2YZfl7OHYx57UlQvdIswOwH6HkLY7exc= 2021-11-19T16:45:48.629 INFO:teuthology.kill: smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFMhWB1Nm/+XgK3PpwfOaPUipsemeWhBRms8YzoIVPZg2QFvzA2l5CPz0mnBEdtYZLP8kpETKoo3euzg/QOPHYVX3TKxNjHVe0GT2oyLnSdEQrE4nd4F6ftAmzQfOJgp1OR3Xzp5J7q6QLAyC4IopxMnrBwRpg3Sxp56pdAXR0sYLs63BSE1NGhHbqBrTyGLLmkU6tDuR4qSbUiZMuB9xraSY5rkUNBclTtSzdyA/xeGa4Ld4cY9p0PUxcJ8bs6pidTZfsfB1c4h+2/ka4Op6AjsZLnBqDFMia8bLHsdjyOVXpSW1eEQsHUmznQs3sZotouYlh/NlgfLAaMyTqTEHYtKoZTw0omBpMEODlKyHjTueFOIkpffYeBwleLreQucAjCZSlfhsQX9hcMWWlql8ofS4+O4+Pk45x+9Gu/AFHQCZ+z9+1G78bFoWBJ9zN1fqoL6upO79yC2IbC0Kq9SeqB5LxPHE5F+JbGnERo7oU+OTlLLwbS0XVHnQH0jc/KNE= 2021-11-19T16:45:48.654 INFO:teuthology.kill:2021-11-19 16:45:48,653.653 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-19T16:45:48.657 INFO:teuthology.kill:2021-11-19 16:45:48,656.656 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-19T16:45:48.730 INFO:teuthology.kill:2021-11-19 16:45:48,730.730 INFO:teuthology.orchestra.console:Power off smithi183 2021-11-19T16:45:48.743 INFO:teuthology.kill:2021-11-19 16:45:48,743.743 INFO:teuthology.orchestra.console:Power off smithi016 2021-11-19T16:45:57.109 INFO:teuthology.kill:2021-11-19 16:45:57,108.108 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-11-19T16:45:57.256 INFO:teuthology.kill:2021-11-19 16:45:57,255.255 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2021-11-19T16:46:01.234 INFO:teuthology.kill:2021-11-19 16:46:01,233.233 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-11-19T16:46:01.392 INFO:teuthology.kill:2021-11-19 16:46:01,392.392 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2021-11-19T16:48:01.753 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15