2022-05-05T23:45:14.547 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166
2022-05-05T23:45:14.676 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2022-05-05T23:45:14.677 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2022-05-05T23:45:14.678 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2022-05-05T23:45:14.697 INFO:teuthology.lock.ops:Node 'smithi103.front.sepia.ceph.com' reimaging is complete
2022-05-05T23:45:14.698 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2022-05-05T23:45:14.699 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2022-05-05T23:45:14.699 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2022-05-05T23:45:14.718 INFO:teuthology.lock.ops:Node 'smithi167.front.sepia.ceph.com' reimaging is complete
2022-05-05T23:45:14.910 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 8.stream
2022-05-05T23:45:14.937 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 8.stream
2022-05-05T23:45:15.244 INFO:teuthology.orchestra.console:Power off smithi103
2022-05-05T23:45:15.282 INFO:teuthology.orchestra.console:Power off smithi167
2022-05-05T23:45:23.641 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2022-05-05T23:45:23.742 INFO:teuthology.orchestra.console:Power on smithi167
2022-05-05T23:45:27.725 INFO:teuthology.orchestra.console:Power off for smithi103 completed
2022-05-05T23:45:27.826 INFO:teuthology.orchestra.console:Power on smithi103
2022-05-05T23:45:32.098 INFO:teuthology.orchestra.console:Power on for smithi167 completed
2022-05-05T23:45:32.199 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2022-05-05T23:45:36.188 INFO:teuthology.orchestra.console:Power on for smithi103 completed
2022-05-05T23:45:36.289 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2022-05-05T23:50:19.097 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-05T23:50:19.388 INFO:teuthology.provision.fog.smithi167:Node is ready
2022-05-05T23:50:19.406 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2022-05-05T23:50:19.465 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2022-05-05T23:50:19.838 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2022-05-05T23:50:41.149 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-05T23:50:41.444 INFO:teuthology.provision.fog.smithi103:Node is ready
2022-05-05T23:50:41.462 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com
2022-05-05T23:50:41.522 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103
2022-05-05T23:50:41.871 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2022-05-05T23:50:42.020 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com
2022-05-05T23:50:42.021 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-05T23:50:42.040 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2022-05-05T23:50:42.040 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-05T23:50:42.060 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server
2022-05-05T23:50:42.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2022-05-05T23:50:42.261 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64
2022-05-05T23:50:42.318 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream"
2022-05-05T23:50:42.319 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8"
2022-05-05T23:50:42.319 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos"
2022-05-05T23:50:42.319 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora"
2022-05-05T23:50:42.319 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8"
2022-05-05T23:50:42.319 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8"
2022-05-05T23:50:42.320 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-05T23:50:42.320 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2022-05-05T23:50:42.320 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-05T23:50:42.320 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/"
2022-05-05T23:50:42.321 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-05T23:50:42.321 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-05T23:50:42.321 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-05T23:50:42.322 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2022-05-05T23:50:42.339 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2022-05-05T23:50:42.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2022-05-05T23:50:42.651 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2022-05-05T23:50:42.709 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2022-05-05T23:50:42.709 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8"
2022-05-05T23:50:42.709 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2022-05-05T23:50:42.710 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2022-05-05T23:50:42.710 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8"
2022-05-05T23:50:42.710 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2022-05-05T23:50:42.710 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8"
2022-05-05T23:50:42.711 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2022-05-05T23:50:42.711 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-05-05T23:50:42.711 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2022-05-05T23:50:42.711 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-05-05T23:50:42.712 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-05-05T23:50:42.712 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-05-05T23:50:42.712 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2022-05-05T23:50:42.834 INFO:teuthology.dispatcher.supervisor:Running job 6822816
2022-05-05T23:50:42.834 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822816 --name amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822816/orig.config.yaml
2022-05-05T23:50:42.838 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822816
2022-05-05T23:50:42.839 INFO:teuthology.dispatcher.supervisor:Job PID: 8507
2022-05-05T23:50:42.839 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-06T06:21:11.858 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-06T06:21:11.992 INFO:teuthology.kill:Killing Pids: {8507}
2022-05-06T06:21:13.427 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-05-06T06:21:13.428 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-05-06T06:21:13.428 INFO:teuthology.misc:Compressing logs...
2022-05-06T06:21:13.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2022-05-06T06:21:13.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2022-05-06T06:21:13.945 INFO:teuthology.misc:Compressing logs...
2022-05-06T06:21:14.426 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-05-06T06:21:14.457 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-05-06T06:21:14.767 INFO:teuthology.misc:Compressing logs...
2022-05-06T06:21:42.873 INFO:teuthology.kill:No teuthology processes running
2022-05-06T06:21:44.272 INFO:teuthology.kill:Nuking machines: ['smithi103', 'smithi167']
2022-05-06T06:21:45.469 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-06T06:21:45.470 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-06T06:21:45.470 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-05-06T06:21:45.470 INFO:teuthology.kill:  "class": algorithms.Blowfish,
2022-05-06T06:21:45.470 INFO:teuthology.kill:2022-05-06 06:21:45,468.468 INFO:teuthology.nuke:targets:
2022-05-06T06:21:45.471 INFO:teuthology.kill:  smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2y3dtvrEhKvWITRR/PPaYHuwg2iBb5j7+8hW5YTQlH3ieyuhpZqiYip2hZ1WdjbHgLXBilnafwaBYRVnIat/hkMrrbHFfwCa9tk/QFdMQY/FxDWiMBgwLrTbFg7EX3tMpF08yBenOF+/7YvIaczZEEWY9TTmdv0qa4ZRg3JKikSG6dskppwmXVm/0XsIRMHD2txRIZlnQtvRA5Sm7VBBNgxmFnnqByyMY8JN1YsbMWp09RyT1VrNrNWFZxoDRKEDCPJe1NoQ6xlWN0aJY01nwYHEGzAgMOOzrzw1oJyQbaURVnXJVIiQXXmCPQS/8OU5sMKBj6yu3mlH39WFr6umPiP5yP/7szFFnHDSFRBLdXle6PXh1tPMOTEq4yyd1LDWhTVK27KW/i+Lvyr7j8VioVWzqPmAMvLOrIpADoG3vDHL5nVEIBicADMohpHD2BzriEc3mRutXZ5G6El6YqF+5fbhU+9bmRzRKQMnVwva9FekgOiVD4WDoeUBIvtkHD9U=
2022-05-06T06:21:45.471 INFO:teuthology.kill:  smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0S+BjzV3AHzEU6bp+eqlFDJW31UR1KdVBbHdWb8R3zh6VtEILxEx6ndbezuLy9KEsyC70L7h7M88wUMCEUs+u2uSmWrgQBPWIh5zG7R56pzqZp+hQMHg70FUux35jk2ZafkZ9DCH8892w6jjwvmO+7haaBgd7FSVu04KI/6Ct9m5pHKttGp5DhN2MUomQyfkzz56IAE1k1+/IdiR17IQOdJgMYFRQcBLNEzmEntP2VNIzOOm+GBgXeilspTRVy7zkd68LElu6ZoH5hEESJ3lKg1+4KS2TX7SLvxu6lagQDt/X4faCG2eSsTud6Ta6UFcNTXQqi9jMi3Ms1cW86JquWpWLUoZgej4niej8yzSwlaYhPhYSxPsXJlRZdG4ePxhVKUO/0qccPKCA0BNtBWxnVNzcqA0PwC7YyCHkskUQYEiTL62j/zPO94AI2xVcs9b5yIVuvJiRvypl2i6MnnwF3OOjWBUKg9wy8ZPjkWaW5vA+HKH0IybvJXa8tBFJnVM=
2022-05-06T06:21:45.497 INFO:teuthology.kill:2022-05-06 06:21:45,497.497 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-06T06:21:45.501 INFO:teuthology.kill:2022-05-06 06:21:45,501.501 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-06T06:21:45.574 INFO:teuthology.kill:2022-05-06 06:21:45,574.574 INFO:teuthology.orchestra.console:Power off smithi103
2022-05-06T06:21:45.586 INFO:teuthology.kill:2022-05-06 06:21:45,586.586 INFO:teuthology.orchestra.console:Power off smithi167
2022-05-06T06:21:53.939 INFO:teuthology.kill:2022-05-06 06:21:53,939.939 INFO:teuthology.orchestra.console:Power off for smithi103 completed
2022-05-06T06:21:53.945 INFO:teuthology.kill:2022-05-06 06:21:53,944.944 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2022-05-06T06:21:54.090 INFO:teuthology.kill:2022-05-06 06:21:54,089.089 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com
2022-05-06T06:21:54.094 INFO:teuthology.kill:2022-05-06 06:21:54,094.094 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com
2022-05-06T06:23:54.421 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-05-06T06:23:54.523 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi103 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-06_02:40:38-upgrade-wip-yuri-testing-2022-05-05-0838-quincy-distro-default-smithi/6823499
2022-05-06T06:23:54.523 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi167 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-06_02:40:38-upgrade-wip-yuri-testing-2022-05-05-0838-quincy-distro-default-smithi/6823499