2022-10-08T16:41:24.922 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-08T16:41:25.063 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2022-10-08T16:41:25.064 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2022-10-08T16:41:25.064 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2022-10-08T16:41:25.085 INFO:teuthology.lock.ops:Node 'smithi008.front.sepia.ceph.com' reimaging is complete 2022-10-08T16:41:25.085 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging 2022-10-08T16:41:25.086 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server 2022-10-08T16:41:25.086 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2022-10-08T16:41:25.107 INFO:teuthology.lock.ops:Node 'smithi106.front.sepia.ceph.com' reimaging is complete 2022-10-08T16:41:25.299 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.6 2022-10-08T16:41:25.309 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of rhel 8.6 2022-10-08T16:41:25.607 INFO:teuthology.orchestra.console:Power off smithi008 2022-10-08T16:41:25.621 INFO:teuthology.orchestra.console:Power off smithi106 2022-10-08T16:41:38.102 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2022-10-08T16:41:38.107 INFO:teuthology.orchestra.console:Power off for smithi106 completed 2022-10-08T16:41:38.203 INFO:teuthology.orchestra.console:Power on smithi008 2022-10-08T16:41:38.211 INFO:teuthology.orchestra.console:Power on smithi106 2022-10-08T16:41:42.460 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2022-10-08T16:41:42.561 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2022-10-08T16:41:46.574 INFO:teuthology.orchestra.console:Power on for smithi106 completed 2022-10-08T16:41:46.676 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2022-10-08T16:46:11.293 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-08T16:46:11.523 INFO:teuthology.provision.fog.smithi008:Node is ready 2022-10-08T16:46:11.542 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2022-10-08T16:46:11.601 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2022-10-08T16:46:11.954 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2022-10-08T16:46:42.630 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-08T16:46:42.888 INFO:teuthology.provision.fog.smithi106:Node is ready 2022-10-08T16:46:42.952 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2022-10-08T16:46:43.016 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2022-10-08T16:46:43.382 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2022-10-08T16:46:43.583 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2022-10-08T16:46:43.584 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-08T16:46:43.604 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2022-10-08T16:46:43.605 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-08T16:46:43.628 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2022-10-08T16:46:43.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2022-10-08T16:46:43.898 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2022-10-08T16:46:43.956 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2022-10-08T16:46:43.957 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2022-10-08T16:46:43.957 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2022-10-08T16:46:43.957 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2022-10-08T16:46:43.957 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2022-10-08T16:46:43.958 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2022-10-08T16:46:43.958 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-10-08T16:46:43.958 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2022-10-08T16:46:43.958 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-10-08T16:46:43.959 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2022-10-08T16:46:43.959 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-10-08T16:46:43.959 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-08T16:46:43.959 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-10-08T16:46:43.960 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-08T16:46:43.960 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-10-08T16:46:43.960 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-10-08T16:46:43.960 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-10-08T16:46:43.962 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2022-10-08T16:46:43.982 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2022-10-08T16:46:43.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2022-10-08T16:46:44.193 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2022-10-08T16:46:44.257 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Red Hat Enterprise Linux" 2022-10-08T16:46:44.257 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8.6 (Ootpa)" 2022-10-08T16:46:44.258 INFO:teuthology.orchestra.run.smithi106.stdout:ID="rhel" 2022-10-08T16:46:44.258 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="fedora" 2022-10-08T16:46:44.258 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8.6" 2022-10-08T16:46:44.259 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2022-10-08T16:46:44.259 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-10-08T16:46:44.259 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2022-10-08T16:46:44.259 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-10-08T16:46:44.259 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.redhat.com/" 2022-10-08T16:46:44.260 INFO:teuthology.orchestra.run.smithi106.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-10-08T16:46:44.260 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-08T16:46:44.260 INFO:teuthology.orchestra.run.smithi106.stdout: 2022-10-08T16:46:44.260 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-08T16:46:44.260 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-10-08T16:46:44.261 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-10-08T16:46:44.261 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-10-08T16:46:44.261 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2022-10-08T16:46:44.362 INFO:teuthology.dispatcher.supervisor:Running job 7058466 2022-10-08T16:46:44.362 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2022-10-08_15:28:17-fs:mixed-clients-wip-mchangir-qa-no-such-file-or-directory-57655-distro-default-smithi/7058466 --name mchangir-2022-10-08_15:28:17-fs:mixed-clients-wip-mchangir-qa-no-such-file-or-directory-57655-distro-default-smithi --description fs:mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/mchangir-2022-10-08_15:28:17-fs:mixed-clients-wip-mchangir-qa-no-such-file-or-directory-57655-distro-default-smithi/7058466/orig.config.yaml 2022-10-08T16:46:44.367 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2022-10-08_15:28:17-fs:mixed-clients-wip-mchangir-qa-no-such-file-or-directory-57655-distro-default-smithi/7058466 2022-10-08T16:46:44.368 INFO:teuthology.dispatcher.supervisor:Job PID: 28104 2022-10-08T16:46:44.368 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-09T04:47:36.035 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-09T04:47:36.209 INFO:teuthology.kill:Killing Pids: {28104} 2022-10-09T04:47:37.673 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-10-09T04:47:37.673 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2022-10-09T04:47:37.674 INFO:teuthology.misc:Compressing logs... 2022-10-09T04:47:37.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2022-10-09T04:47:37.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2022-10-09T04:47:38.215 INFO:teuthology.misc:Compressing logs... 2022-10-09T04:47:38.255 INFO:teuthology.orchestra.run.smithi008.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-10-09T04:47:38.285 INFO:teuthology.orchestra.run.smithi106.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-10-09T04:47:38.327 INFO:teuthology.orchestra.run.smithi008.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-10-09T04:47:38.327 INFO:teuthology.orchestra.run.smithi008.stderr:tar: Error is not recoverable: exiting now 2022-10-09T04:47:38.356 INFO:teuthology.orchestra.run.smithi106.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-10-09T04:47:38.356 INFO:teuthology.orchestra.run.smithi106.stderr:tar: Error is not recoverable: exiting now 2022-10-09T04:47:38.359 INFO:teuthology.misc:Compressing logs... 2022-10-09T04:47:51.611 INFO:teuthology.kill:No teuthology processes running 2022-10-09T04:47:53.012 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi106'] 2022-10-09T04:47:54.203 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-10-09T04:47:54.204 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-10-09T04:47:54.204 INFO:teuthology.kill:2022-10-09 04:47:54,202.202 INFO:teuthology.nuke:targets: 2022-10-09T04:47:54.204 INFO:teuthology.kill: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI23C9i/5gNzyfwJrxF//cC7Ln2eqA1vix1POa71jVdHTSvtYTJ/mSUpJbKgxlbkbVyxOXqerigA0ICf1k/3hSk= 2022-10-09T04:47:54.204 INFO:teuthology.kill: smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAvj3YgCCux+MMZw21OUpxM2+KGj5xm8xXV4ARUlMiEu6W9wnO5YSeNduxPpjoJvu8yNlXOGGgcPvH/0fnQyaWw= 2022-10-09T04:47:54.205 INFO:teuthology.kill:2022-10-09 04:47:54,202.202 INFO:teuthology.nuke:Checking targets against current locks 2022-10-09T04:47:54.267 INFO:teuthology.kill:2022-10-09 04:47:54,267.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-09T04:47:54.291 INFO:teuthology.kill:2022-10-09 04:47:54,290.290 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-09T04:47:54.353 INFO:teuthology.kill:2022-10-09 04:47:54,352.352 INFO:teuthology.orchestra.console:Power off smithi008 2022-10-09T04:47:54.373 INFO:teuthology.kill:2022-10-09 04:47:54,373.373 INFO:teuthology.orchestra.console:Power off smithi106 2022-10-09T04:48:02.727 INFO:teuthology.kill:2022-10-09 04:48:02,727.727 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2022-10-09T04:48:02.735 INFO:teuthology.kill:2022-10-09 04:48:02,734.734 INFO:teuthology.orchestra.console:Power off for smithi106 completed 2022-10-09T04:48:02.886 INFO:teuthology.kill:2022-10-09 04:48:02,885.885 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2022-10-09T04:48:02.888 INFO:teuthology.kill:2022-10-09 04:48:02,888.888 INFO:teuthology.lock.ops:unlocked: smithi106.front.sepia.ceph.com 2022-10-09T04:50:03.218 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-10-09T04:50:03.335 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-08_22:57:13-rbd-wip-dis-testing-distro-default-smithi/7058777 2022-10-09T04:50:03.335 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi106 but it was locked by another job: /home/teuthworker/archive/dis-2022-10-08_22:57:13-rbd-wip-dis-testing-distro-default-smithi/7058777