2022-05-17T20:26:39.803 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-17T20:26:39.959 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2022-05-17T20:26:39.961 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2022-05-17T20:26:39.961 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2022-05-17T20:26:39.983 INFO:teuthology.lock.ops:Node 'smithi081.front.sepia.ceph.com' reimaging is complete 2022-05-17T20:26:39.985 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2022-05-17T20:26:39.986 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2022-05-17T20:26:39.986 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-05-17T20:26:40.011 INFO:teuthology.lock.ops:Node 'smithi156.front.sepia.ceph.com' reimaging is complete 2022-05-17T20:26:40.199 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream 2022-05-17T20:26:40.233 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.stream 2022-05-17T20:26:40.487 INFO:teuthology.orchestra.console:Power off smithi081 2022-05-17T20:26:40.557 INFO:teuthology.orchestra.console:Power off smithi156 2022-05-17T20:26:48.926 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-05-17T20:26:49.027 INFO:teuthology.orchestra.console:Power on smithi156 2022-05-17T20:26:52.999 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2022-05-17T20:26:53.101 INFO:teuthology.orchestra.console:Power on smithi081 2022-05-17T20:26:57.395 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2022-05-17T20:26:57.496 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2022-05-17T20:27:01.483 INFO:teuthology.orchestra.console:Power on for smithi081 completed 2022-05-17T20:27:01.585 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2022-05-17T20:31:39.519 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-17T20:31:39.783 INFO:teuthology.provision.fog.smithi081:Node is ready 2022-05-17T20:31:39.801 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2022-05-17T20:31:39.860 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2022-05-17T20:31:40.215 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2022-05-17T20:31:50.620 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-17T20:31:50.916 INFO:teuthology.provision.fog.smithi156:Node is ready 2022-05-17T20:31:50.935 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2022-05-17T20:31:50.993 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2022-05-17T20:31:51.354 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2022-05-17T20:31:51.579 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2022-05-17T20:31:51.580 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-17T20:31:51.606 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2022-05-17T20:31:51.607 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-17T20:31:51.631 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2022-05-17T20:31:51.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2022-05-17T20:31:51.901 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2022-05-17T20:31:51.958 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2022-05-17T20:31:51.959 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2022-05-17T20:31:51.959 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2022-05-17T20:31:51.959 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2022-05-17T20:31:51.959 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2022-05-17T20:31:51.959 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2022-05-17T20:31:51.960 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-17T20:31:51.960 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2022-05-17T20:31:51.960 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-17T20:31:51.961 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2022-05-17T20:31:51.961 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-17T20:31:51.961 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-17T20:31:51.961 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-17T20:31:51.963 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2022-05-17T20:31:51.984 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2022-05-17T20:31:51.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-05-17T20:31:52.195 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2022-05-17T20:31:52.255 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2022-05-17T20:31:52.255 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2022-05-17T20:31:52.255 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2022-05-17T20:31:52.256 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2022-05-17T20:31:52.256 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2022-05-17T20:31:52.256 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2022-05-17T20:31:52.257 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-17T20:31:52.257 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2022-05-17T20:31:52.257 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-17T20:31:52.257 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2022-05-17T20:31:52.258 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-17T20:31:52.258 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-17T20:31:52.258 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-17T20:31:52.259 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-05-17T20:31:52.383 INFO:teuthology.dispatcher.supervisor:Running job 6837832 2022-05-17T20:31:52.384 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837832 --name amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837832/orig.config.yaml 2022-05-17T20:31:52.389 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837832 2022-05-17T20:31:52.390 INFO:teuthology.dispatcher.supervisor:Job PID: 19544 2022-05-17T20:31:52.390 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-18T03:02:22.451 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-18T03:02:22.644 INFO:teuthology.kill:Killing Pids: {19544} 2022-05-18T03:02:24.087 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-18T03:02:24.088 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-18T03:02:24.088 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:02:24.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2022-05-18T03:02:24.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-05-18T03:02:24.675 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:02:25.088 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T03:02:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T03:02:25.369 INFO:teuthology.misc:Compressing logs... 2022-05-18T03:02:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/ceph-client.admin.105289.log: file size changed while zipping 2022-05-18T03:02:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/ceph-client.admin.105399.log: file size changed while zipping 2022-05-18T03:02:45.722 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/ceph-client.admin.105144.log: file size changed while zipping 2022-05-18T03:02:55.050 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/ceph-client.admin.105276.log: file size changed while zipping 2022-05-18T03:03:20.333 INFO:teuthology.kill:No teuthology processes running 2022-05-18T03:03:21.858 INFO:teuthology.kill:Nuking machines: ['smithi081', 'smithi156'] 2022-05-18T03:03:23.049 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-18T03:03:23.050 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-18T03:03:23.050 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-18T03:03:23.051 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-18T03:03:23.051 INFO:teuthology.kill:2022-05-18 03:03:23,049.049 INFO:teuthology.nuke:targets: 2022-05-18T03:03:23.051 INFO:teuthology.kill: smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqlECRWO35edFfUrNVnF5I6N1iQtoQvyvoO/lXrMzz7NRZwZunC3yDJks+jpNCrOXlUj+vsFxdjEX9vC8va7sLjOkMIlWjgCtPprzGH2TFqll5DrugwgBTjMoi3sB3N0CoA86UJtXjtAUeBa87Vf9oTQLIMOFml7k4BpGCKjWPvw4guYQCeeF3N/+iWIhKT8zbYfVS5fCy+7Q2FszQWpx+8h2eUTJuwjPd36LaMXayY+EM70F4qAMcZtN2bq3h46PFe07kvaChByTHtNDwjzojdaNsZR7Jvu/5AfsNEAqmz2tJurdUH4qSNkRxZnl7S+GUKqysJzECQ+zmuYUApGLfnnmi3GHAFkOguO3F6bsEOZA8I/E1OH8gjLF0HISbAMGPiDbVVcvmL6s+1Gt2agTLL9osR3CvZu5PmyZC8ZydCtxIkWVpE18W1CHURMLIMbTPO9sR7Eh5EYdMNmN/w7SQycEXMP6KwJdCMZjPf3HYPcIu7G1JjUg82wCYcK8SVXE= 2022-05-18T03:03:23.052 INFO:teuthology.kill: smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8pxaNCSOSxqQDt0ysgvQrJ2KrSTmuF2sEXEREFzmWa6yJYSuZem+O3g7PrmCnCjAZQUzGaSqpoS9SJx/w3KdwZuOP4anyOmHqaE9dujnKbQ+ri57jkQh2ginPdSI3YHfqJSRvt1pJC+p12hj0UOtg4JM78kmuA3R47kHzI1u5b19FUcQhvTGxE0BTXSI27M3W2e2F7ZzHQmpm2tW0faWUZYm3fMblXwMR4BQvxIF27xUWgO2e2T3GzlPK7HIeERLHIuDvinRYk63byce0mxjEvd+9UDOXZ5zmfNhxqRs9yQeCgOVeQ7g+2I3vpi6KdRxMl03tJH+HPR8mA+VyHIedqWbgo7/JRLU6F0xdbJhy7Zqgd3KswisDKMjBfqHdFJXqKsxS1MRjN8aEa7mYKDeKJoX6FsaJjVTaUMy8ECIRIgrZ9Omc23NXyGLTCoLSEC0Rh5WFq+6U9Awz6frazBkoDoXxtOTO/V2c2plZVSXatJpa1y/tFF2zNyWagHSuV0k= 2022-05-18T03:03:23.078 INFO:teuthology.kill:2022-05-18 03:03:23,078.078 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T03:03:23.081 INFO:teuthology.kill:2022-05-18 03:03:23,081.081 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T03:03:23.168 INFO:teuthology.kill:2022-05-18 03:03:23,168.168 INFO:teuthology.orchestra.console:Power off smithi081 2022-05-18T03:03:23.183 INFO:teuthology.kill:2022-05-18 03:03:23,183.183 INFO:teuthology.orchestra.console:Power off smithi156 2022-05-18T03:03:31.546 INFO:teuthology.kill:2022-05-18 03:03:31,546.546 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-05-18T03:03:31.696 INFO:teuthology.kill:2022-05-18 03:03:31,695.695 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2022-05-18T03:03:35.651 INFO:teuthology.kill:2022-05-18 03:03:35,650.650 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2022-05-18T03:03:35.800 INFO:teuthology.kill:2022-05-18 03:03:35,799.799 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2022-05-18T03:05:36.159 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-18T03:05:36.268 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi081 but it was locked by another job: /home/teuthworker/archive/nojha-2022-05-17_22:38:06-rados-wip-lrc-fix-pacific-distro-basic-smithi/6839071 2022-05-18T03:05:36.269 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi156 but it was locked by another job: /home/teuthworker/archive/nojha-2022-05-17_22:38:06-rados-wip-lrc-fix-pacific-distro-basic-smithi/6839071