2022-10-31T23:45:09.028 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-31T23:45:09.180 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2022-10-31T23:45:09.181 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2022-10-31T23:45:09.182 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2022-10-31T23:45:09.201 INFO:teuthology.lock.ops:Node 'smithi045.front.sepia.ceph.com' reimaging is complete 2022-10-31T23:45:09.201 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2022-10-31T23:45:09.201 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2022-10-31T23:45:09.202 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2022-10-31T23:45:09.222 INFO:teuthology.lock.ops:Node 'smithi071.front.sepia.ceph.com' reimaging is complete 2022-10-31T23:45:09.412 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.stream 2022-10-31T23:45:09.440 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 8.stream 2022-10-31T23:45:09.796 INFO:teuthology.orchestra.console:Power off smithi045 2022-10-31T23:45:09.812 INFO:teuthology.orchestra.console:Power off smithi071 2022-10-31T23:45:09.940 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2022-10-31T23:45:09.951 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2022-10-31T23:45:10.042 INFO:teuthology.orchestra.console:Power on smithi045 2022-10-31T23:45:10.052 INFO:teuthology.orchestra.console:Power on smithi071 2022-10-31T23:45:18.407 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2022-10-31T23:45:18.411 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2022-10-31T23:45:18.509 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2022-10-31T23:45:18.513 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2022-10-31T23:48:58.801 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-31T23:49:19.168 INFO:teuthology.provision.fog.smithi045:Node is ready 2022-10-31T23:49:19.193 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2022-10-31T23:49:19.255 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2022-10-31T23:49:19.645 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2022-10-31T23:49:22.547 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-31T23:49:48.307 INFO:teuthology.provision.fog.smithi071:Node is ready 2022-10-31T23:49:48.331 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2022-10-31T23:49:48.392 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2022-10-31T23:49:48.748 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2022-10-31T23:49:48.939 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2022-10-31T23:49:48.940 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-31T23:49:48.967 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2022-10-31T23:49:48.968 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-31T23:49:48.988 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2022-10-31T23:49:48.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2022-10-31T23:49:49.263 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2022-10-31T23:49:49.322 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2022-10-31T23:49:49.322 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2022-10-31T23:49:49.323 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2022-10-31T23:49:49.323 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2022-10-31T23:49:49.323 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2022-10-31T23:49:49.323 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2022-10-31T23:49:49.324 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2022-10-31T23:49:49.324 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2022-10-31T23:49:49.324 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-10-31T23:49:49.324 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2022-10-31T23:49:49.325 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-31T23:49:49.325 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-31T23:49:49.325 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-10-31T23:49:49.327 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2022-10-31T23:49:49.347 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2022-10-31T23:49:49.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2022-10-31T23:49:49.551 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2022-10-31T23:49:49.609 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2022-10-31T23:49:49.609 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2022-10-31T23:49:49.609 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2022-10-31T23:49:49.609 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2022-10-31T23:49:49.610 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2022-10-31T23:49:49.610 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2022-10-31T23:49:49.611 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2022-10-31T23:49:49.611 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2022-10-31T23:49:49.611 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-10-31T23:49:49.611 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2022-10-31T23:49:49.612 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-31T23:49:49.612 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-31T23:49:49.612 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-10-31T23:49:49.613 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2022-10-31T23:49:49.718 INFO:teuthology.dispatcher.supervisor:Running job 7080290 2022-10-31T23:49:49.718 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080290 --name teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080290/orig.config.yaml 2022-10-31T23:49:49.723 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080290 2022-10-31T23:49:49.724 INFO:teuthology.dispatcher.supervisor:Job PID: 32531 2022-10-31T23:49:49.724 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-11-01T11:50:38.106 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-11-01T11:50:38.481 INFO:teuthology.kill:Killing Pids: {32531} 2022-11-01T11:50:39.710 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-11-01T11:50:39.711 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-11-01T11:50:39.711 INFO:teuthology.misc:Compressing logs... 2022-11-01T11:50:39.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2022-11-01T11:50:39.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2022-11-01T11:50:40.425 INFO:teuthology.kill:No teuthology processes running 2022-11-01T11:50:41.583 INFO:teuthology.kill:Nuking machines: ['smithi045', 'smithi071'] 2022-11-01T11:50:42.615 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-11-01T11:50:42.616 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-11-01T11:50:42.616 INFO:teuthology.kill:2022-11-01 11:50:42,614.614 INFO:teuthology.nuke:targets: 2022-11-01T11:50:42.616 INFO:teuthology.kill: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJCBkQdwDj5YShDwbIpx9En2ZGqT35/cBCRPjaa3ZRt9px6DUNrvPvktpQb4+HKXMIq7fEZx1Zrg9seQB6lB6aA= 2022-11-01T11:50:42.617 INFO:teuthology.kill: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCotdVj7uETJgdHhhSTHmneZRU+nSIP+JrNobjwA6kLZPrfmvesejnKwaQIsoe+L6by7hH1b5rKMGScKtQ/VwMMMayRRONYJNKolNTWYQZIyv+lJgg0k6vdLo8APksssmS1oHg7Woab3bAVuKvPWsjFMe/iEeL2CAFRama2zynJBZD912t8RmtSXKsUivHCEo3XRyVzZE5fBF92+hT+rrVSdnqtzbzsj6fherOukRofCgPzhyZcn6I9tewsLSP0NLmy3hCOy94SFAcLbgmf0yFTQXU/3ZKOiIa4NcIAaxhcESBZBubgBuYCIzK1qW15Z3fS/33dNdFWRgzH1OtrfoN1d8MejQ8P4S61b5dVAyZDfIH9WCsEwIjfmPvO9UNGOB/fnXuoD0QMXDK+e4UpagnOaQ4/9LI71lj/eZiMAcU7RsVbs2L0M7E1VJs/fvkowO6igm+vKIhoVslIyqhlEdCBROlz4XLpoNz2ccHQKqHOKwSbqJQNvuCvPSpCDC86t5c= 2022-11-01T11:50:42.617 INFO:teuthology.kill:2022-11-01 11:50:42,614.614 INFO:teuthology.nuke:Checking targets against current locks 2022-11-01T11:50:42.667 INFO:teuthology.kill:2022-11-01 11:50:42,666.666 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-01T11:50:42.689 INFO:teuthology.kill:2022-11-01 11:50:42,689.689 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-01T11:50:42.746 INFO:teuthology.kill:2022-11-01 11:50:42,746.746 INFO:teuthology.orchestra.console:Power off smithi045 2022-11-01T11:50:42.778 INFO:teuthology.kill:2022-11-01 11:50:42,778.778 INFO:teuthology.orchestra.console:Power off smithi071 2022-11-01T11:50:51.112 INFO:teuthology.kill:2022-11-01 11:50:51,111.111 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2022-11-01T11:50:51.258 INFO:teuthology.kill:2022-11-01 11:50:51,257.257 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com 2022-11-01T11:50:55.245 INFO:teuthology.kill:2022-11-01 11:50:55,244.244 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2022-11-01T11:50:55.394 INFO:teuthology.kill:2022-11-01 11:50:55,394.394 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2022-11-01T11:52:55.607 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-11-01T11:52:55.719 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi045 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080330 2022-11-01T11:52:55.719 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi071 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-25_03:15:06-fs-quincy-distro-default-smithi/7080330