2022-05-24T09:22:16.052 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-24T09:22:16.249 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2022-05-24T09:22:16.251 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2022-05-24T09:22:16.251 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2022-05-24T09:22:16.273 INFO:teuthology.lock.ops:Node 'smithi040.front.sepia.ceph.com' reimaging is complete 2022-05-24T09:22:16.274 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2022-05-24T09:22:16.274 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2022-05-24T09:22:16.274 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2022-05-24T09:22:16.295 INFO:teuthology.lock.ops:Node 'smithi138.front.sepia.ceph.com' reimaging is complete 2022-05-24T09:22:16.296 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2022-05-24T09:22:16.297 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2022-05-24T09:22:16.297 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2022-05-24T09:22:16.375 INFO:teuthology.lock.ops:Node 'smithi149.front.sepia.ceph.com' reimaging is complete 2022-05-24T09:22:16.516 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.stream 2022-05-24T09:22:16.523 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.stream 2022-05-24T09:22:16.588 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream 2022-05-24T09:22:16.849 INFO:teuthology.orchestra.console:Power off smithi138 2022-05-24T09:22:16.867 INFO:teuthology.orchestra.console:Power off smithi040 2022-05-24T09:22:16.950 INFO:teuthology.orchestra.console:Power off smithi149 2022-05-24T09:22:25.223 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2022-05-24T09:22:25.235 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2022-05-24T09:22:25.325 INFO:teuthology.orchestra.console:Power on smithi138 2022-05-24T09:22:25.337 INFO:teuthology.orchestra.console:Power on smithi040 2022-05-24T09:22:29.431 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2022-05-24T09:22:29.533 INFO:teuthology.orchestra.console:Power on smithi149 2022-05-24T09:22:33.692 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2022-05-24T09:22:33.699 INFO:teuthology.orchestra.console:Power on for smithi040 completed 2022-05-24T09:22:33.789 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2022-05-24T09:22:33.793 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2022-05-24T09:22:33.800 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2022-05-24T09:22:33.891 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2022-05-24T09:26:50.620 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-24T09:26:50.863 INFO:teuthology.provision.fog.smithi040:Node is ready 2022-05-24T09:26:50.883 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2022-05-24T09:26:50.943 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2022-05-24T09:26:51.326 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2022-05-24T09:27:14.774 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-24T09:27:15.136 INFO:teuthology.provision.fog.smithi138:Node is ready 2022-05-24T09:27:15.154 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2022-05-24T09:27:15.211 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2022-05-24T09:27:15.546 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2022-05-24T09:27:29.856 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-24T09:27:30.151 INFO:teuthology.provision.fog.smithi149:Node is ready 2022-05-24T09:27:30.168 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2022-05-24T09:27:30.226 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2022-05-24T09:27:30.589 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2022-05-24T09:27:30.856 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2022-05-24T09:27:30.857 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-24T09:27:30.879 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2022-05-24T09:27:30.879 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-24T09:27:30.899 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2022-05-24T09:27:30.899 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-24T09:27:30.919 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2022-05-24T09:27:30.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2022-05-24T09:27:31.194 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2022-05-24T09:27:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2022-05-24T09:27:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2022-05-24T09:27:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2022-05-24T09:27:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2022-05-24T09:27:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2022-05-24T09:27:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2022-05-24T09:27:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-24T09:27:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2022-05-24T09:27:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-24T09:27:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2022-05-24T09:27:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-24T09:27:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-24T09:27:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-24T09:27:31.257 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2022-05-24T09:27:31.279 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2022-05-24T09:27:31.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2022-05-24T09:27:31.490 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2022-05-24T09:27:31.549 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2022-05-24T09:27:31.549 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8" 2022-05-24T09:27:31.550 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2022-05-24T09:27:31.550 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2022-05-24T09:27:31.550 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2022-05-24T09:27:31.550 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2022-05-24T09:27:31.551 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-24T09:27:31.551 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2022-05-24T09:27:31.551 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-24T09:27:31.551 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2022-05-24T09:27:31.551 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-24T09:27:31.552 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-24T09:27:31.552 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-24T09:27:31.552 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2022-05-24T09:27:31.571 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2022-05-24T09:27:31.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2022-05-24T09:27:31.733 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2022-05-24T09:27:31.791 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2022-05-24T09:27:31.792 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2022-05-24T09:27:31.792 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2022-05-24T09:27:31.792 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2022-05-24T09:27:31.793 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2022-05-24T09:27:31.793 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2022-05-24T09:27:31.793 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-24T09:27:31.793 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2022-05-24T09:27:31.793 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-24T09:27:31.794 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2022-05-24T09:27:31.794 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-24T09:27:31.794 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-24T09:27:31.794 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-24T09:27:31.795 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2022-05-24T09:27:31.899 INFO:teuthology.dispatcher.supervisor:Running job 6846910 2022-05-24T09:27:31.899 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-05-24_04:17:02-fs-pacific-distro-default-smithi/6846910 --name teuthology-2022-05-24_04:17:02-fs-pacific-distro-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} -- /home/teuthworker/archive/teuthology-2022-05-24_04:17:02-fs-pacific-distro-default-smithi/6846910/orig.config.yaml 2022-05-24T09:27:31.905 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-05-24_04:17:02-fs-pacific-distro-default-smithi/6846910 2022-05-24T09:27:31.906 INFO:teuthology.dispatcher.supervisor:Job PID: 8776 2022-05-24T09:27:31.906 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-24T15:58:02.813 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-24T15:58:03.012 INFO:teuthology.kill:Killing Pids: {8776} 2022-05-24T15:58:04.659 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2022-05-24T15:58:04.660 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2022-05-24T15:58:04.661 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2022-05-24T15:58:04.661 INFO:teuthology.misc:Compressing logs... 2022-05-24T15:58:04.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2022-05-24T15:58:04.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2022-05-24T15:58:05.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2022-05-24T15:58:05.597 INFO:teuthology.misc:Compressing logs... 2022-05-24T15:58:05.896 INFO:teuthology.misc:Compressing logs... 2022-05-24T16:05:00.187 INFO:teuthology.kill:No teuthology processes running 2022-05-24T16:05:01.664 INFO:teuthology.kill:Nuking machines: ['smithi040', 'smithi138', 'smithi149'] 2022-05-24T16:05:02.870 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-24T16:05:02.871 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-24T16:05:02.872 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-24T16:05:02.872 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-24T16:05:02.872 INFO:teuthology.kill:2022-05-24 16:05:02,870.870 INFO:teuthology.nuke:targets: 2022-05-24T16:05:02.872 INFO:teuthology.kill: smithi040.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUr63MOoAUu9Qyn4Hr7zdrULW8bM4yvVThL+VKR5SRqfH/5HCFTMYS0YDRgpuK0llSttQj8ClW3UMaOXAVfL+BmX87uCUoNQYZP3GKPqW9iYpXlWh0l6AaWwn0N1t4/ANJPJ3J/FV0S1st5dkaP11jZ0HJvDUid1pz7t0BmenzXcbvJkkNMcpUKAGpVeG9OVyg6O9VuDRmdGo+yucqE3BEbGOvZMOFY+l5nYpgtb3GsxvEEC2hnunzOjSwfGIBuf2MZGKg9tkv8JV8aXzG6M33gxfCUvcBvCVvzzPcX1l+H4jRE5h7DqNRkIzFdABLZ9CgFmXpAPNTwLmVcQearJgpB7vKRe7pdmcg109ZOW24HN1oy/Kq8Qsi3axbESTlsYL3NfZx0mEhIgelCtW9HjqE7tAIW3nN5w4hmrfzKNOsAP4ykjSwVV0krmRy2RHVkj/sxeVQgPS1/5gwlUEj0z4EUDYwVlhNkHqaHafGFE89cazYD4EJUOL8bH/pbkFT6w0= 2022-05-24T16:05:02.873 INFO:teuthology.kill: smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDk9oZKt2JQIfu/V/u65HPLtsL/gaTQrzV8Fa4AL93GXk/pJ/C3LEr7LQaqhpEdkwX65eGGDRwn0dU78mTqMyWpFrfWRVpYixyuK63GBtdZKnU/J8UeTn4TGvilwf00/6kF9i+KnLyXdOML7dCfKA11Z4x8yHXYKxZPkfoDmO9CG5UUwDMkLunF2bSaU4eBMBSLrgtAeNtgY7sD1jAZM0b8wTT/aAE2osDNWTbCv9lMg9Tm95URHv49/nu/tEUHmMsIMDMrWEoyS39zcwx9FqD5dlbcOhpCD+cSt3NBhX/LyiWH1pUyK6VgV/cBtUIq30mWyuJpKNlQNxOyqtnOgJAhJ/T8RWFHGJKklF8PmwZUCIuFFGDjV5Urf7cUzcbbNWKt6HzBdiyfQ98rJ7LrT5Q8fkqcVUz3xqSMHhMdszRzs0+YhID5wOQANTOb3PVl9U2ADVSKoeFTGP9MZ9J0NfkCGqr7ficm0GS4sJtw88K0qdybLcKGo9ILRBbQ6LdaObE= 2022-05-24T16:05:02.873 INFO:teuthology.kill: smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDK/U1ZSEPtRlVo3ByoTZ8DETjYQPx6PjAPvyoUKP1bHSopgfixdRUY7G/M0IwBT+r0r0WPa1p4EH8lt4UyMETI2iciRc0kIMScinoz45B/sSKwzoDFMlBNBmx1NEhWy13CWbD7b9vjOB27hdOwaZcl8BZldrr4nL+wtFU605p3Vo5zTYZRRD/lCPNZ0mgxsGeRfv8+hNVVmW2pe5xLzV7WRe//phjANPnRHwweVCaESUbcpMJwpg87vjdmAJl6AmtnVoG5+CRyyWe46/aZcclyevydsUKCZHHndruG1Spxy5OrwOuWv0ppdS1XH4TYDO8si9nv+TNdiL3aV0TApxAqrAiUTtY8N74f0/jOzIttYHFBoLC2JHenhEVrOewPv4ZWVACQ0bwDYueKhCZq804+htCyu08KKeXRl6iZkRa81I5k7lq6Q1nG/2itlEZtXLixE+D3ICLSQl539go45iy5n3tReBp1I08VPh3ceKxoU8behzV915Sh2cVFJoplumk= 2022-05-24T16:05:02.899 INFO:teuthology.kill:2022-05-24 16:05:02,899.899 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-24T16:05:02.902 INFO:teuthology.kill:2022-05-24 16:05:02,902.902 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-24T16:05:02.903 INFO:teuthology.kill:2022-05-24 16:05:02,903.903 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-24T16:05:02.985 INFO:teuthology.kill:2022-05-24 16:05:02,985.985 INFO:teuthology.orchestra.console:Power off smithi149 2022-05-24T16:05:03.011 INFO:teuthology.kill:2022-05-24 16:05:03,011.011 INFO:teuthology.orchestra.console:Power off smithi138 2022-05-24T16:05:03.024 INFO:teuthology.kill:2022-05-24 16:05:03,023.023 INFO:teuthology.orchestra.console:Power off smithi040 2022-05-24T16:05:11.410 INFO:teuthology.kill:2022-05-24 16:05:11,410.410 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2022-05-24T16:05:11.578 INFO:teuthology.kill:2022-05-24 16:05:11,577.577 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2022-05-24T16:05:15.512 INFO:teuthology.kill:2022-05-24 16:05:15,512.512 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2022-05-24T16:05:15.519 INFO:teuthology.kill:2022-05-24 16:05:15,519.519 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2022-05-24T16:05:15.677 INFO:teuthology.kill:2022-05-24 16:05:15,677.677 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2022-05-24T16:05:15.682 INFO:teuthology.kill:2022-05-24 16:05:15,682.682 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2022-05-24T16:07:16.023 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15