2022-10-31T13:58:03.346 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-31T13:58:03.498 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2022-10-31T13:58:03.500 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2022-10-31T13:58:03.500 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2022-10-31T13:58:03.521 INFO:teuthology.lock.ops:Node 'smithi012.front.sepia.ceph.com' reimaging is complete 2022-10-31T13:58:03.522 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2022-10-31T13:58:03.522 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-10-31T13:58:03.523 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-10-31T13:58:03.550 INFO:teuthology.lock.ops:Node 'smithi163.front.sepia.ceph.com' reimaging is complete 2022-10-31T13:58:03.738 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of rhel 8.4 2022-10-31T13:58:03.774 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of rhel 8.4 2022-10-31T13:58:04.082 INFO:teuthology.orchestra.console:Power off smithi012 2022-10-31T13:58:04.099 INFO:teuthology.orchestra.console:Power off smithi163 2022-10-31T13:58:04.228 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2022-10-31T13:58:04.239 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-10-31T13:58:04.330 INFO:teuthology.orchestra.console:Power on smithi012 2022-10-31T13:58:04.341 INFO:teuthology.orchestra.console:Power on smithi163 2022-10-31T13:58:08.591 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-10-31T13:58:08.693 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-10-31T13:58:12.695 INFO:teuthology.orchestra.console:Power on for smithi012 completed 2022-10-31T13:58:12.796 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2022-10-31T14:03:08.775 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-31T14:03:24.755 INFO:teuthology.provision.fog.smithi012:Node is ready 2022-10-31T14:03:24.776 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2022-10-31T14:03:24.834 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2022-10-31T14:03:25.200 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2022-10-31T14:03:46.904 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-31T14:04:06.684 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-10-31T14:04:06.703 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2022-10-31T14:04:06.760 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2022-10-31T14:04:07.106 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-10-31T14:04:07.291 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2022-10-31T14:04:07.292 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-31T14:04:07.313 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-10-31T14:04:07.314 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-31T14:04:07.332 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2022-10-31T14:04:07.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2022-10-31T14:04:07.598 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2022-10-31T14:04:07.654 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Red Hat Enterprise Linux" 2022-10-31T14:04:07.654 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8.4 (Ootpa)" 2022-10-31T14:04:07.655 INFO:teuthology.orchestra.run.smithi012.stdout:ID="rhel" 2022-10-31T14:04:07.655 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="fedora" 2022-10-31T14:04:07.655 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8.4" 2022-10-31T14:04:07.655 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2022-10-31T14:04:07.656 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-10-31T14:04:07.656 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2022-10-31T14:04:07.656 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-10-31T14:04:07.656 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.redhat.com/" 2022-10-31T14:04:07.657 INFO:teuthology.orchestra.run.smithi012.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-10-31T14:04:07.657 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-31T14:04:07.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2022-10-31T14:04:07.657 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-31T14:04:07.657 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-10-31T14:04:07.658 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-10-31T14:04:07.658 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-10-31T14:04:07.659 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2022-10-31T14:04:07.688 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-10-31T14:04:07.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-10-31T14:04:07.880 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-10-31T14:04:07.934 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2022-10-31T14:04:07.934 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.4 (Ootpa)" 2022-10-31T14:04:07.934 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2022-10-31T14:04:07.934 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2022-10-31T14:04:07.935 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.4" 2022-10-31T14:04:07.935 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2022-10-31T14:04:07.935 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-10-31T14:04:07.935 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2022-10-31T14:04:07.936 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-10-31T14:04:07.936 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2022-10-31T14:04:07.936 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-10-31T14:04:07.936 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-31T14:04:07.937 INFO:teuthology.orchestra.run.smithi163.stdout: 2022-10-31T14:04:07.937 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-31T14:04:07.937 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-10-31T14:04:07.937 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-10-31T14:04:07.937 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-10-31T14:04:07.938 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-10-31T14:04:08.034 INFO:teuthology.dispatcher.supervisor:Running job 7080262 2022-10-31T14:04:08.035 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080262 --name teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} -- /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080262/orig.config.yaml 2022-10-31T14:04:08.039 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080262 2022-10-31T14:04:08.040 INFO:teuthology.dispatcher.supervisor:Job PID: 13035 2022-10-31T14:04:08.040 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-11-01T02:04:28.256 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-11-01T02:04:28.405 INFO:teuthology.kill:Killing Pids: {13035} 2022-11-01T02:04:29.651 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-11-01T02:04:29.652 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2022-11-01T02:04:29.652 INFO:teuthology.misc:Compressing logs... 2022-11-01T02:04:29.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2022-11-01T02:04:29.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-11-01T02:04:30.295 INFO:teuthology.kill:No teuthology processes running 2022-11-01T02:04:31.500 INFO:teuthology.kill:Nuking machines: ['smithi012', 'smithi163'] 2022-11-01T02:04:32.557 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-11-01T02:04:32.558 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-11-01T02:04:32.558 INFO:teuthology.kill:2022-11-01 02:04:32,557.557 INFO:teuthology.nuke:targets: 2022-11-01T02:04:32.559 INFO:teuthology.kill: smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyxUi/JmdbJ60ddT3tk22K9dVdqpR1lvpFQWUh8P2FRWVRHnXv8+MeRiTH8iQi4wKxzbOdDwDdXOx7nTd0JIaCfBJ/H0POvbdJTiiaou6BbaUMYecR0kS1bfX6WMu73VChcPUynrCwCIga1aSqghwbIrJ+PUczFgG3LEcXwG9lawyaHxgGHLVE6x603t0q9pv2n6PN3iWXrovWeN0q2Zc62HTpH68+MtqPQJvylmOkCiw74VfHle3swEzAKCKjHnPasZnBKibmM3t+b+kbyetv6MKShrWun/tYXvxSEsR39XcZIC8XKiVFnb4Gldb3GejinEagJE8GrJU4mB3kmZnJFgDbCxm7TcIVATbAZ1A0QtlQ/T8M2aTa52wH/hGTpqLVdhq9Hk/pCxpfF02jcd1ZFlQ04GeaY0IiXRHaiKESUnvLboBlloEBiOVCw/5jtWQY12/wAZehTsdVh0vZi2xsWzAD7hkh5hjrcIX8gmapLiGfHUWvuC/hDSWnkPUXHkk= 2022-11-01T02:04:32.559 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOyTa3IRIWs03q/cufcQrWrIT2JTR9Jc2Bvjag54jRcPgxpTJhHEhANKDOPzFsYEgwtrFQng/oyLt9wLPT78D67U//X68ruhVUTECtb0eulqVbrnJ3WoMHlwnjK4tSrv3XR0ov37qsEeLwBbed02ybEdNWapLAQL0bPnLoAjIU85ajMkuYG2KfBNxCs51Gxngw+P8lSAlYkHBXrSNetEdQHvHYqd/snEraA2x0t0alhRwBZuQlmMdzhVhRG1IrE6ume8fFtggndemqM32wk1C0L+mn0Tb70f7/y1cQ2RJN/uzrCxoKPFMdQ1Ft2+hePT+X+TC6bGZbVSYsmIDZZHztQP9jh5t10XmQ2mOEfPUJNckeuO2gE4YQ2f/sex4M8gikvfSX1TpIak3gPPHQ/YvW1jbcWhEO//L4qKIQ/qfh9Ip1us8PJEa9japPpS5cfQmag5VJGf54i3ZhoMH9+2sLhrCzWeiki247QDPsccUzzHtnEOpkPu6PbvVIY/x+sf0= 2022-11-01T02:04:32.559 INFO:teuthology.kill:2022-11-01 02:04:32,557.557 INFO:teuthology.nuke:Checking targets against current locks 2022-11-01T02:04:32.608 INFO:teuthology.kill:2022-11-01 02:04:32,607.607 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-01T02:04:32.630 INFO:teuthology.kill:2022-11-01 02:04:32,630.630 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-01T02:04:32.685 INFO:teuthology.kill:2022-11-01 02:04:32,685.685 INFO:teuthology.orchestra.console:Power off smithi012 2022-11-01T02:04:32.721 INFO:teuthology.kill:2022-11-01 02:04:32,721.721 INFO:teuthology.orchestra.console:Power off smithi163 2022-11-01T02:04:41.054 INFO:teuthology.kill:2022-11-01 02:04:41,053.053 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2022-11-01T02:04:41.201 INFO:teuthology.kill:2022-11-01 02:04:41,200.200 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2022-11-01T02:04:45.190 INFO:teuthology.kill:2022-11-01 02:04:45,190.190 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-11-01T02:04:45.336 INFO:teuthology.kill:2022-11-01 02:04:45,336.336 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-11-01T02:06:45.602 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-11-01T02:06:45.712 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi012 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080309 2022-11-01T02:06:45.713 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080307