2022-05-05T23:46:55.642 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-05T23:46:55.781 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2022-05-05T23:46:55.782 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T23:46:55.782 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2022-05-05T23:46:55.803 INFO:teuthology.lock.ops:Node 'smithi078.front.sepia.ceph.com' reimaging is complete 2022-05-05T23:46:55.804 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2022-05-05T23:46:55.804 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T23:46:55.805 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-05-05T23:46:55.824 INFO:teuthology.lock.ops:Node 'smithi105.front.sepia.ceph.com' reimaging is complete 2022-05-05T23:46:56.010 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 8.stream 2022-05-05T23:46:56.034 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2022-05-05T23:46:56.346 INFO:teuthology.orchestra.console:Power off smithi078 2022-05-05T23:46:56.408 INFO:teuthology.orchestra.console:Power off smithi105 2022-05-05T23:47:04.769 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-05-05T23:47:04.870 INFO:teuthology.orchestra.console:Power on smithi105 2022-05-05T23:47:08.828 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2022-05-05T23:47:08.929 INFO:teuthology.orchestra.console:Power on smithi078 2022-05-05T23:47:13.249 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2022-05-05T23:47:13.351 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2022-05-05T23:47:17.293 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2022-05-05T23:47:17.394 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2022-05-05T23:51:15.016 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T23:51:39.985 INFO:teuthology.provision.fog.smithi105:Node is ready 2022-05-05T23:51:40.004 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2022-05-05T23:51:40.060 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2022-05-05T23:51:40.448 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2022-05-05T23:51:58.153 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T23:51:58.447 INFO:teuthology.provision.fog.smithi078:Node is ready 2022-05-05T23:51:58.506 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2022-05-05T23:51:58.565 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2022-05-05T23:51:58.912 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2022-05-05T23:51:59.067 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2022-05-05T23:51:59.068 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T23:51:59.089 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2022-05-05T23:51:59.089 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T23:51:59.108 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2022-05-05T23:51:59.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2022-05-05T23:51:59.320 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2022-05-05T23:51:59.377 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2022-05-05T23:51:59.377 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8" 2022-05-05T23:51:59.377 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2022-05-05T23:51:59.377 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2022-05-05T23:51:59.378 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8" 2022-05-05T23:51:59.378 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2022-05-05T23:51:59.378 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-05T23:51:59.379 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2022-05-05T23:51:59.379 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-05T23:51:59.379 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2022-05-05T23:51:59.379 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-05T23:51:59.380 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-05T23:51:59.380 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-05T23:51:59.381 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2022-05-05T23:51:59.400 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2022-05-05T23:51:59.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-05-05T23:51:59.670 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2022-05-05T23:51:59.728 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2022-05-05T23:51:59.728 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2022-05-05T23:51:59.728 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2022-05-05T23:51:59.729 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2022-05-05T23:51:59.729 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2022-05-05T23:51:59.729 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2022-05-05T23:51:59.729 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-05T23:51:59.730 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2022-05-05T23:51:59.730 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-05T23:51:59.731 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2022-05-05T23:51:59.732 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-05T23:51:59.732 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-05T23:51:59.733 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-05T23:51:59.733 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-05-05T23:51:59.835 INFO:teuthology.dispatcher.supervisor:Running job 6822819 2022-05-05T23:51:59.836 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822819 --name amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822819/orig.config.yaml 2022-05-05T23:51:59.840 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822819 2022-05-05T23:51:59.841 INFO:teuthology.dispatcher.supervisor:Job PID: 15814 2022-05-05T23:51:59.841 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-06T06:22:29.008 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-06T06:22:29.202 INFO:teuthology.kill:Killing Pids: {15814} 2022-05-06T06:22:30.597 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-06T06:22:30.598 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-06T06:22:30.598 INFO:teuthology.misc:Compressing logs... 2022-05-06T06:22:30.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2022-05-06T06:22:30.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-05-06T06:22:31.105 INFO:teuthology.misc:Compressing logs... 2022-05-06T06:22:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T06:22:31.601 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-06T06:22:31.910 INFO:teuthology.misc:Compressing logs... 2022-05-06T06:22:39.727 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/ceph-client.admin.52185.log: file size changed while zipping 2022-05-06T06:23:02.155 INFO:teuthology.kill:No teuthology processes running 2022-05-06T06:23:03.532 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi105'] 2022-05-06T06:23:04.661 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-06T06:23:04.662 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-06T06:23:04.662 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-06T06:23:04.663 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-06T06:23:04.663 INFO:teuthology.kill:2022-05-06 06:23:04,661.661 INFO:teuthology.nuke:targets: 2022-05-06T06:23:04.663 INFO:teuthology.kill: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA6u/Llhw33aZbHOZ6FzUG3Ep/KYq5MZjhB6P5jierNg18UikpM5QKetpLmkihgmfUDuTCe/2D72gf0AU0laCGY2gDPGVnWwFQLJ9ZCm6yMAdsgzWZMColqwetupbaydRgqsuD6izr5HUaCCBdea8T5DXbz3uDvzjUvF1wxe0d+QVVvrBPaYm/TS0BuAoS1SZnxQTB0VZUZk21V8kIYovGVtHOOReaA22AJYCyWqJy5Lx/cQxRmJQzA3eaQlkHDCCw0GjOxNj5eI57Hsp4griTzINB2myV62Vn2ZnZ2+oaI8I7zsFeh/sWBr8uUno5GlKEw69WBx42ubWykYov55MwRBQd0eIdO6V5DfYITtz5pdkbACpEWsd57Ippp+DJqUdTzx3BLi0J54PM1Wqqrs41kuDubvHaA3C5uRypgy9E0XFUpTzH3/3tquyLqen/tMGnkoF3w0Cdm6vkbmKeh3gx9tqMbmzFi/YLoqjt0g488v9GxczeYVpXhnhRUdSdt8E= 2022-05-06T06:23:04.663 INFO:teuthology.kill: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtTuakL2i1/Np1OPRhW/f0TQeQWmxqyYtGiL+4k+oC6VwNpK6gUzdFva4Dxz6KHognZ4u2ftx5BCXWrFE+hSmCOHC9U8KAxJH8UmEVhMmd97GHCmRGV23vBd7JKqwmP4KAsWfQNOkTrTLC2h48kca4GGKkezarSMCOabDXPV5i8nGvfYz+MzouqGnx1o/5iuGhkNkjAOtf7FegXsS+4unDrjPOI9Xv21Xiga8/5EXyG42qKWbwpYq75XH5M+gng9E2wTwqiIGQYkSeLpA03PiAOURN20p8HN9wLqRjTyARukvrY27RtXTE9856irgDW8pdiFudF52MtRE4NYp64QiMWLL2Q3yBrGEP/HxCGubDdy+qn/SUO++U7A8C+4RGR+OH7Fm32bpFgm17T6JmB7Tu2/FP/HVS7k1A+zSHogfpwaCscviYeM2mPXHSLfuI0SoZQmcyoLmy8dRaVYlLVqxPhhyUNDAtelZpvShciaGlYJ9n3ii5DlDA3HQO+wrrtKk= 2022-05-06T06:23:04.688 INFO:teuthology.kill:2022-05-06 06:23:04,687.687 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T06:23:04.690 INFO:teuthology.kill:2022-05-06 06:23:04,690.690 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-06T06:23:04.766 INFO:teuthology.kill:2022-05-06 06:23:04,766.766 INFO:teuthology.orchestra.console:Power off smithi078 2022-05-06T06:23:04.778 INFO:teuthology.kill:2022-05-06 06:23:04,777.777 INFO:teuthology.orchestra.console:Power off smithi105 2022-05-06T06:23:13.138 INFO:teuthology.kill:2022-05-06 06:23:13,138.138 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2022-05-06T06:23:13.142 INFO:teuthology.kill:2022-05-06 06:23:13,142.142 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-05-06T06:23:13.289 INFO:teuthology.kill:2022-05-06 06:23:13,288.288 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2022-05-06T06:23:13.296 INFO:teuthology.kill:2022-05-06 06:23:13,296.296 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2022-05-06T06:25:13.625 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-06T06:25:13.736 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi078 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-06_02:40:38-upgrade-wip-yuri-testing-2022-05-05-0838-quincy-distro-default-smithi/6823499 2022-05-06T06:25:13.737 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-06_02:40:38-upgrade-wip-yuri-testing-2022-05-05-0838-quincy-distro-default-smithi/6823499