2022-05-05T17:37:58.589 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-05T17:37:58.709 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2022-05-05T17:37:58.710 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T17:37:58.711 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-05-05T17:37:58.732 INFO:teuthology.lock.ops:Node 'smithi107.front.sepia.ceph.com' reimaging is complete 2022-05-05T17:37:58.733 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2022-05-05T17:37:58.733 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T17:37:58.733 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2022-05-05T17:37:58.753 INFO:teuthology.lock.ops:Node 'smithi131.front.sepia.ceph.com' reimaging is complete 2022-05-05T17:37:58.948 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream 2022-05-05T17:37:58.960 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream 2022-05-05T17:37:59.268 INFO:teuthology.orchestra.console:Power off smithi107 2022-05-05T17:37:59.280 INFO:teuthology.orchestra.console:Power off smithi131 2022-05-05T17:38:07.639 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-05-05T17:38:07.644 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2022-05-05T17:38:07.741 INFO:teuthology.orchestra.console:Power on smithi107 2022-05-05T17:38:07.747 INFO:teuthology.orchestra.console:Power on smithi131 2022-05-05T17:38:16.103 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2022-05-05T17:38:16.107 INFO:teuthology.orchestra.console:Power on for smithi131 completed 2022-05-05T17:38:16.205 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2022-05-05T17:38:16.208 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2022-05-05T17:42:45.267 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T17:42:45.560 INFO:teuthology.provision.fog.smithi131:Node is ready 2022-05-05T17:42:45.576 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2022-05-05T17:42:45.632 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2022-05-05T17:42:45.961 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2022-05-05T17:43:00.212 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T17:43:00.480 INFO:teuthology.provision.fog.smithi107:Node is ready 2022-05-05T17:43:00.537 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2022-05-05T17:43:00.596 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2022-05-05T17:43:00.932 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2022-05-05T17:43:01.116 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2022-05-05T17:43:01.117 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T17:43:01.137 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2022-05-05T17:43:01.137 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T17:43:01.156 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2022-05-05T17:43:01.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-05-05T17:43:01.350 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2022-05-05T17:43:01.406 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2022-05-05T17:43:01.407 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2022-05-05T17:43:01.407 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2022-05-05T17:43:01.407 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2022-05-05T17:43:01.407 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2022-05-05T17:43:01.408 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2022-05-05T17:43:01.408 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-05T17:43:01.408 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2022-05-05T17:43:01.408 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-05T17:43:01.408 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2022-05-05T17:43:01.409 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-05T17:43:01.409 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-05T17:43:01.409 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-05T17:43:01.410 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-05-05T17:43:01.429 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2022-05-05T17:43:01.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2022-05-05T17:43:01.689 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2022-05-05T17:43:01.746 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2022-05-05T17:43:01.747 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2022-05-05T17:43:01.747 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2022-05-05T17:43:01.747 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2022-05-05T17:43:01.748 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2022-05-05T17:43:01.748 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2022-05-05T17:43:01.748 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-05T17:43:01.748 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2022-05-05T17:43:01.748 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-05T17:43:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2022-05-05T17:43:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-05T17:43:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-05T17:43:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-05T17:43:01.750 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2022-05-05T17:43:01.848 INFO:teuthology.dispatcher.supervisor:Running job 6822724 2022-05-05T17:43:01.848 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822724 --name amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822724/orig.config.yaml 2022-05-05T17:43:01.851 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822724 2022-05-05T17:43:01.852 INFO:teuthology.dispatcher.supervisor:Job PID: 28398 2022-05-05T17:43:01.852 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-06T00:13:30.971 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-06T00:13:31.157 INFO:teuthology.kill:Killing Pids: {28398} 2022-05-06T00:13:32.630 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-06T00:13:32.631 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-06T00:13:32.631 INFO:teuthology.misc:Compressing logs... 2022-05-06T00:13:32.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-05-06T00:13:32.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2022-05-06T00:13:33.154 INFO:teuthology.misc:Compressing logs... 2022-05-06T00:13:33.688 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T00:13:33.706 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T00:13:34.045 INFO:teuthology.misc:Compressing logs... 2022-05-06T00:13:41.360 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/ceph-osd.3.log: file size changed while zipping 2022-05-06T00:13:57.023 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/ceph-client.admin.51716.log: file size changed while zipping 2022-05-06T00:14:14.505 INFO:teuthology.kill:No teuthology processes running 2022-05-06T00:14:15.924 INFO:teuthology.kill:Nuking machines: ['smithi107', 'smithi131'] 2022-05-06T00:14:17.089 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-06T00:14:17.089 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-06T00:14:17.090 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-06T00:14:17.090 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-06T00:14:17.090 INFO:teuthology.kill:2022-05-06 00:14:17,088.088 INFO:teuthology.nuke:targets: 2022-05-06T00:14:17.091 INFO:teuthology.kill: smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA1vx61FNApRMfRKblN/Bja8l2/2TEjN/3pRXAp/F5iq8e9TGQVU1DOQSCq+fllOMuKAVROjMlhy33+F3rl26/yENzemVSK5OH4Y9jwU9vCII2xMka9AyGKa1ctqg7qf//ggZFf9p3eswZTYtXFYFGS03fjPiCl4Z23ehg72ph4mf53WeLG8RgVuToJyj+DaPtq/X1MPBhwnvADnpqRHWpG7rQ61mgAIQE1qxE0U4WyQ1UQ/fT/in9As26APPJTgGMpYvZNZBwFct4D0a4/YRbtWQ4Wt+GrrVkjRCxaKAktnKwrkFscADvOee8aWeZKsuQOb5+5nUqDqLL24eIrpAiCJubQxNSBRgSdscxvoN7hSyCKpe1IZTttrLED39Fr9IeUWy7QEQs3ANCPjLt9TpML4o6yY5flfpeSIQx4fohzg2RamFF2snv8Jm3KYN/iiasNe/uZ0b82A+BjYgN2Apsn54OqOqZgRf8YCRe0VOyjAK0a5Sjs60k8Ryxatml03M= 2022-05-06T00:14:17.091 INFO:teuthology.kill: smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDI0VF4iHfCCPuGbNQCa8edJs2O2HBdDPBYGQB8bsXMaWEihOZTQahwPB++t4EaRjuuOpH2WpBClxo0PnqbYsGBRQTPakn62j2WHf6lHIPmT5AIUKafPv3zvo227WGPpVbcXY34KIW5y5MdzPELccqNX7twxWj/WzkJilBjgdQp7B9e3leiwh1Iqnz/n6CSA0n8L5NLQ2KIKZLfYZFZ49xPzdZLCd4rW7ENlrzN74DURtCTql8bZXF6ziwFn26ULIjpn8wUQ+nVOVkhDIfi2aDOzbO2HwWjuoXPgQlBW/9LfGZvsHJus1pU/eg6MqBO8Zqcu3W+n7FAM9QAKNQ9KWWuuL+eA43/Olu36RRTeVrPI+R7bA/QlKieTw4fMKso1h3ttUcltd1Pna5Seqd36+a+WLt61innu1bUhFU4zlsBLkb34jp3pQanFWql09qtVPJgqEgkQzf1nTPr9x1NXyeBf73IZ0bj+NAQzFKE4Vfqa8uKdH+oZU3juaDFA2xFCTk= 2022-05-06T00:14:17.119 INFO:teuthology.kill:2022-05-06 00:14:17,119.119 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T00:14:17.122 INFO:teuthology.kill:2022-05-06 00:14:17,122.122 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T00:14:17.197 INFO:teuthology.kill:2022-05-06 00:14:17,197.197 INFO:teuthology.orchestra.console:Power off smithi107 2022-05-06T00:14:17.209 INFO:teuthology.kill:2022-05-06 00:14:17,209.209 INFO:teuthology.orchestra.console:Power off smithi131 2022-05-06T00:14:25.570 INFO:teuthology.kill:2022-05-06 00:14:25,569.569 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2022-05-06T00:14:25.719 INFO:teuthology.kill:2022-05-06 00:14:25,718.718 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2022-05-06T00:14:29.680 INFO:teuthology.kill:2022-05-06 00:14:29,680.680 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-05-06T00:14:29.827 INFO:teuthology.kill:2022-05-06 00:14:29,827.827 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2022-05-06T00:16:30.162 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-06T00:16:30.267 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi107 but it was locked by another job: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822831 2022-05-06T00:16:30.267 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi131 but it was locked by another job: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822831