2022-05-05T21:30:56.253 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-05T21:30:56.375 INFO:teuthology.lock.ops:Start node 'smithi085.front.sepia.ceph.com' reimaging 2022-05-05T21:30:56.376 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T21:30:56.377 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-05-05T21:30:56.398 INFO:teuthology.lock.ops:Node 'smithi085.front.sepia.ceph.com' reimaging is complete 2022-05-05T21:30:56.399 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2022-05-05T21:30:56.399 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T21:30:56.399 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2022-05-05T21:30:56.419 INFO:teuthology.lock.ops:Node 'smithi117.front.sepia.ceph.com' reimaging is complete 2022-05-05T21:30:56.605 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of centos 8.stream 2022-05-05T21:30:56.620 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 8.stream 2022-05-05T21:30:56.903 INFO:teuthology.orchestra.console:Power off smithi085 2022-05-05T21:30:56.918 INFO:teuthology.orchestra.console:Power off smithi117 2022-05-05T21:30:57.057 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2022-05-05T21:30:57.158 INFO:teuthology.orchestra.console:Power on smithi117 2022-05-05T21:31:05.262 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-05-05T21:31:05.364 INFO:teuthology.orchestra.console:Power on smithi085 2022-05-05T21:31:05.515 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2022-05-05T21:31:05.616 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2022-05-05T21:31:09.615 INFO:teuthology.orchestra.console:Power on for smithi085 completed 2022-05-05T21:31:09.716 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish 2022-05-05T21:35:08.983 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T21:35:19.004 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T21:35:34.373 INFO:teuthology.provision.fog.smithi117:Node is ready 2022-05-05T21:35:34.432 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2022-05-05T21:35:34.489 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2022-05-05T21:35:34.891 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2022-05-05T21:35:44.140 INFO:teuthology.provision.fog.smithi085:Node is ready 2022-05-05T21:35:44.158 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com 2022-05-05T21:35:44.215 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085 2022-05-05T21:35:44.626 INFO:teuthology.provision.fog.smithi085:Deploy complete! 2022-05-05T21:35:44.785 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com 2022-05-05T21:35:44.786 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T21:35:44.806 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2022-05-05T21:35:44.806 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T21:35:44.825 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server 2022-05-05T21:35:44.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-05-05T21:35:45.023 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2022-05-05T21:35:45.079 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="CentOS Stream" 2022-05-05T21:35:45.080 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8" 2022-05-05T21:35:45.080 INFO:teuthology.orchestra.run.smithi085.stdout:ID="centos" 2022-05-05T21:35:45.081 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="rhel fedora" 2022-05-05T21:35:45.081 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8" 2022-05-05T21:35:45.081 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8" 2022-05-05T21:35:45.081 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-05T21:35:45.082 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31" 2022-05-05T21:35:45.082 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-05T21:35:45.082 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://centos.org/" 2022-05-05T21:35:45.082 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-05T21:35:45.083 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-05T21:35:45.083 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-05T21:35:45.084 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-05-05T21:35:45.104 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2022-05-05T21:35:45.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2022-05-05T21:35:45.369 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2022-05-05T21:35:45.426 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2022-05-05T21:35:45.426 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8" 2022-05-05T21:35:45.427 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2022-05-05T21:35:45.427 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2022-05-05T21:35:45.427 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8" 2022-05-05T21:35:45.427 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2022-05-05T21:35:45.428 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-05T21:35:45.428 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2022-05-05T21:35:45.428 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-05T21:35:45.428 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2022-05-05T21:35:45.428 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-05T21:35:45.429 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-05T21:35:45.429 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-05T21:35:45.429 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2022-05-05T21:35:45.525 INFO:teuthology.dispatcher.supervisor:Running job 6822781 2022-05-05T21:35:45.526 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822781 --name amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822781/orig.config.yaml 2022-05-05T21:35:45.529 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822781 2022-05-05T21:35:45.530 INFO:teuthology.dispatcher.supervisor:Job PID: 1437 2022-05-05T21:35:45.530 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-06T04:06:14.805 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-06T04:06:15.005 INFO:teuthology.kill:Killing Pids: {1437} 2022-05-06T04:06:16.488 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-06T04:06:16.489 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-06T04:06:16.490 INFO:teuthology.misc:Compressing logs... 2022-05-06T04:06:16.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-05-06T04:06:16.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2022-05-06T04:06:17.079 INFO:teuthology.misc:Compressing logs... 2022-05-06T04:06:17.550 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T04:06:17.585 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T04:06:17.894 INFO:teuthology.misc:Compressing logs... 2022-05-06T04:06:45.310 INFO:teuthology.kill:No teuthology processes running 2022-05-06T04:06:46.727 INFO:teuthology.kill:Nuking machines: ['smithi085', 'smithi117'] 2022-05-06T04:06:47.876 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-06T04:06:47.877 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-06T04:06:47.877 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-06T04:06:47.878 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-06T04:06:47.878 INFO:teuthology.kill:2022-05-06 04:06:47,876.876 INFO:teuthology.nuke:targets: 2022-05-06T04:06:47.878 INFO:teuthology.kill: smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcuINA7aaR7i1ePQ+Fn/VP4z77Tk+Q5Lu6ZbK51PF2YaI+VYHGGY17/N/+gTeK4A3oKGwWWiXTNenL28NlKn4j+CQmtfZ7BpbT5e38xJMw2pNXCEvdOhLS12GMBZSzfGz5m9zNzTz0/6Thekz8KWB/+rLZKbgxM32BCP1m+YfraMbTtgbybOJzyneP0ENDKdC2uEJ0/jNs3kFSMnJz2Ga3fmv79BggyjigBE/FPzpNwCZbkpp5+ww2k05Tfyphxw0PAOHFa420cRD9unVIBqK69ezEPjA4+MHOY3XNxIhQZ5tLPKlTi5w+VMZ3dqfixMP2UlacA96p7PxLhRPDU9vy3/Z3wUKcMK2Tvi+V10h9HJ+b/I/OGY3duPumG5hx7w9ZoK+2CNA43PW+4nQidCoAsBWe/KFEH1K/q3tK45704g6d2qi9g1LYyUSmY7YaCygT7gbS0Hm0rStOc8cCsC0mmk/B5ZEotjC7GNM81RcMFSOvcdezJt6bTZ6sYrzYAJE= 2022-05-06T04:06:47.879 INFO:teuthology.kill: smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEkJbCjZK0j7qYqASB3qMzfqIhRoCo11E8wBrYta5KE187e3RUVim1NNYPTAV6O3qGizpm8efaEdkhtXfN1o+qY4NgQHpJBTCE3JrkJ4Bq2Wvgwfj4uucBIfrFRo8bf41yrjYw7KtaytQKDtLsxjDfXzOqvvZrYd6PdCxmpyaq4oCp5bnNGQwH+uwIhT0TPVsXcA0TFy4+UdcP5nruut2FKH4hEv0nNYwGr9d+q2KScu6NILRvcMzkil1KS0oSkidsFAx+90btS3PkPxlNALFtem2U9yDoAece6ZRWWTrX1igNGbVy/g72RvBqXwAsy/qkQxX7auzwEptxzKA9tOhUUimMx+WgWiMTTB8wIVI6dbJ5tzcYAzzQHhNAtRbUYY4fk/2dex9kzqIA9OjCx/rcKU31uR6yzSdBdkOv0D5z+lDfGSXjRcF1Q32w/B8cjFIYguDNYjzUTgQb/6OV/NZwvgtCzqCD6KP8X9kgMWMY9PtOG56blb3pG13GoNMa2W8= 2022-05-06T04:06:47.905 INFO:teuthology.kill:2022-05-06 04:06:47,904.904 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T04:06:47.908 INFO:teuthology.kill:2022-05-06 04:06:47,908.908 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T04:06:47.985 INFO:teuthology.kill:2022-05-06 04:06:47,985.985 INFO:teuthology.orchestra.console:Power off smithi117 2022-05-06T04:06:48.000 INFO:teuthology.kill:2022-05-06 04:06:47,999.999 INFO:teuthology.orchestra.console:Power off smithi085 2022-05-06T04:06:56.352 INFO:teuthology.kill:2022-05-06 04:06:56,352.352 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2022-05-06T04:06:56.366 INFO:teuthology.kill:2022-05-06 04:06:56,366.366 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-05-06T04:06:56.501 INFO:teuthology.kill:2022-05-06 04:06:56,500.500 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com 2022-05-06T04:06:56.521 INFO:teuthology.kill:2022-05-06 04:06:56,521.521 INFO:teuthology.lock.ops:unlocked: smithi085.front.sepia.ceph.com 2022-05-06T04:08:56.862 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-06T04:08:56.961 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi085 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-06_02:40:38-upgrade-wip-yuri-testing-2022-05-05-0838-quincy-distro-default-smithi/6823466 2022-05-06T04:08:56.962 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi117 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-06_02:40:38-upgrade-wip-yuri-testing-2022-05-05-0838-quincy-distro-default-smithi/6823466