2022-05-07T04:48:24.238 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-07T04:48:24.405 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2022-05-07T04:48:24.408 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2022-05-07T04:48:24.409 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2022-05-07T04:48:24.436 INFO:teuthology.lock.ops:Node 'smithi143.front.sepia.ceph.com' reimaging is complete 2022-05-07T04:48:24.437 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2022-05-07T04:48:24.437 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2022-05-07T04:48:24.437 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2022-05-07T04:48:24.462 INFO:teuthology.lock.ops:Node 'smithi150.front.sepia.ceph.com' reimaging is complete 2022-05-07T04:48:24.650 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.stream 2022-05-07T04:48:24.676 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 8.stream 2022-05-07T04:48:24.993 INFO:teuthology.orchestra.console:Power off smithi143 2022-05-07T04:48:25.032 INFO:teuthology.orchestra.console:Power off smithi150 2022-05-07T04:48:33.397 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2022-05-07T04:48:33.498 INFO:teuthology.orchestra.console:Power on smithi150 2022-05-07T04:48:37.475 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2022-05-07T04:48:37.577 INFO:teuthology.orchestra.console:Power on smithi143 2022-05-07T04:48:41.857 INFO:teuthology.orchestra.console:Power on for smithi150 completed 2022-05-07T04:48:41.958 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2022-05-07T04:48:45.943 INFO:teuthology.orchestra.console:Power on for smithi143 completed 2022-05-07T04:48:46.044 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2022-05-07T04:52:54.307 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-07T04:53:19.765 INFO:teuthology.provision.fog.smithi143:Node is ready 2022-05-07T04:53:19.784 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2022-05-07T04:53:19.842 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2022-05-07T04:53:20.215 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2022-05-07T04:53:37.922 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-07T04:53:38.193 INFO:teuthology.provision.fog.smithi150:Node is ready 2022-05-07T04:53:38.250 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2022-05-07T04:53:38.309 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2022-05-07T04:53:38.671 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2022-05-07T04:53:38.835 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2022-05-07T04:53:38.836 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-07T04:53:38.854 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2022-05-07T04:53:38.855 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-07T04:53:38.876 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2022-05-07T04:53:38.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2022-05-07T04:53:39.086 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2022-05-07T04:53:39.144 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2022-05-07T04:53:39.144 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2022-05-07T04:53:39.145 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2022-05-07T04:53:39.145 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2022-05-07T04:53:39.145 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2022-05-07T04:53:39.145 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2022-05-07T04:53:39.146 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-07T04:53:39.146 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2022-05-07T04:53:39.146 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-07T04:53:39.146 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2022-05-07T04:53:39.146 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-07T04:53:39.147 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-07T04:53:39.147 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-07T04:53:39.148 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2022-05-07T04:53:39.166 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2022-05-07T04:53:39.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2022-05-07T04:53:39.377 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2022-05-07T04:53:39.434 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2022-05-07T04:53:39.434 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8" 2022-05-07T04:53:39.435 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2022-05-07T04:53:39.435 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2022-05-07T04:53:39.435 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8" 2022-05-07T04:53:39.435 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2022-05-07T04:53:39.435 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-07T04:53:39.436 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2022-05-07T04:53:39.436 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-07T04:53:39.436 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2022-05-07T04:53:39.436 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-07T04:53:39.437 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-07T04:53:39.437 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-07T04:53:39.437 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2022-05-07T04:53:39.536 INFO:teuthology.dispatcher.supervisor:Running job 6824867 2022-05-07T04:53:39.537 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-06_08:37:20-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6824867 --name amathuri-2022-05-06_08:37:20-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-06_08:37:20-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6824867/orig.config.yaml 2022-05-07T04:53:39.541 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-06_08:37:20-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6824867 2022-05-07T04:53:39.542 INFO:teuthology.dispatcher.supervisor:Job PID: 24736 2022-05-07T04:53:39.542 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-07T11:23:50.403 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-07T11:23:50.603 INFO:teuthology.kill:Killing Pids: {24736} 2022-05-07T11:23:52.001 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-07T11:23:52.002 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-07T11:23:52.002 INFO:teuthology.misc:Compressing logs... 2022-05-07T11:23:52.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2022-05-07T11:23:52.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2022-05-07T11:23:52.539 INFO:teuthology.misc:Compressing logs... 2022-05-07T11:23:52.932 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-07T11:23:52.959 INFO:teuthology.orchestra.run.smithi150.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-07T11:23:53.222 INFO:teuthology.misc:Compressing logs... 2022-05-07T11:24:25.885 INFO:teuthology.kill:No teuthology processes running 2022-05-07T11:24:27.268 INFO:teuthology.kill:Nuking machines: ['smithi143', 'smithi150'] 2022-05-07T11:24:28.390 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-07T11:24:28.391 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-07T11:24:28.391 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-07T11:24:28.391 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-07T11:24:28.392 INFO:teuthology.kill:2022-05-07 11:24:28,389.389 INFO:teuthology.nuke:targets: 2022-05-07T11:24:28.392 INFO:teuthology.kill: smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDllH3BtNsp/6aeuyPAmiXUFxfXtl9ngLaFIjGuRMaLdSCvi3r0KXvkCPg/G1dSWAiJtYaTS/MVxlQUdvBH22SK/WlQ5D2pl3RJy82dlmxJuni91Kb73AUpTAe3N44vFVj/C1QYyF7iHQ1qv8MsjiHWVsku+KKUMMg9eCi0UeuU2eYZbyWANSbFrKqdmVU+q9mTz3fZfyUAzLEvdKtaKVD6Q9xB9zL1NvC1ZM1LRKzzwyefZrEBsuMPrFmk09ptUY1WmTdOPa3whU9jNiomPIkMuVnL31/Mh668gs3iZpsDnUy41iymp8BRBbgmMfpYnDLHB1frzor0OAg/fj4deo9KtuZ6bVqEu97ZTUIaPYbcxRL3CLxyUe1Us8wjw3XAURQGkTxWlI/QAeQ/6n3J25ul7I5UOS855oZfxq/8Vfs0AVuDydZqUZ2B2ODzNv2Ixz+G7j9VAoLHw4ZpEy8VcqSktoNjjUdwrjb76JvwXNyyFCOuvdD4rvtk2e8u+TZPC68= 2022-05-07T11:24:28.392 INFO:teuthology.kill: smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/ZCamBGdm4/g/ryNDM2Gd6FQJHXQSRZhYtaS8SwYITudh+U11BmIKGshrmnWlUzARGZBGcY5+vxhrArVXQ0j66K2VjzzQ7N44hMFnBlMq7KbDqdZbghvPMc4DD0qFfoJiKYzzDICm6vJGh7B05lFM712TrISnyHFypx+YHMyvgiE9PhNkTv5A3M2x1bjiCz/g1EzWbf8yauFMy0o/HP2QgZXrCucJR/hY8W3xofGbwuf8r7/qBrLndCHfpRV8zxljybIzaQvUrQ0eSe0JOUWq6o1iHMJslxGbEO3PS+ibRn3aoWjASd00x3IV8CZmVfv+FC2MhD6sIHNBUKTxaJBeIovZSPJBtMaqbEBTNT7py9ZxTEWnNp6YnBfbIBXH4o3QrBYG4+DbhQE96cBozb39UOVyNMkCPuxKcl0EfaHMFbMKI1PEJZRPOygVqRxQrvAQR2SuR5HRJTfA2CRmwdDZ2t4gy2zml1XeCe+2GJvEmFU5kiPID/8jKPRAv7XmQns= 2022-05-07T11:24:28.417 INFO:teuthology.kill:2022-05-07 11:24:28,417.417 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-07T11:24:28.420 INFO:teuthology.kill:2022-05-07 11:24:28,420.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-07T11:24:28.491 INFO:teuthology.kill:2022-05-07 11:24:28,490.490 INFO:teuthology.orchestra.console:Power off smithi143 2022-05-07T11:24:28.501 INFO:teuthology.kill:2022-05-07 11:24:28,501.501 INFO:teuthology.orchestra.console:Power off smithi150 2022-05-07T11:24:40.970 INFO:teuthology.kill:2022-05-07 11:24:40,970.970 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2022-05-07T11:24:40.975 INFO:teuthology.kill:2022-05-07 11:24:40,975.975 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2022-05-07T11:24:41.113 INFO:teuthology.kill:2022-05-07 11:24:41,113.113 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2022-05-07T11:24:41.116 INFO:teuthology.kill:2022-05-07 11:24:41,116.116 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com 2022-05-07T11:26:41.423 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-07T11:26:41.524 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi143 but it was locked by another job: /home/teuthworker/archive/lflores-2022-05-04_18:59:38-rados-wip-55077-octopus-distro-default-smithi/6821048 2022-05-07T11:26:41.525 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi150 but it was locked by another job: /home/teuthworker/archive/lflores-2022-05-04_18:59:38-rados-wip-55077-octopus-distro-default-smithi/6821048