2022-04-01T06:51:19.147 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-01T06:51:19.279 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging 2022-04-01T06:51:19.280 INFO:teuthology.lock.ops:Updating [ubuntu@smithi039.front.sepia.ceph.com]: reset os type and version on server 2022-04-01T06:51:19.280 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2022-04-01T06:51:19.299 INFO:teuthology.lock.ops:Node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging is complete 2022-04-01T06:51:19.299 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging 2022-04-01T06:51:19.299 INFO:teuthology.lock.ops:Updating [ubuntu@smithi101.front.sepia.ceph.com]: reset os type and version on server 2022-04-01T06:51:19.300 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2022-04-01T06:51:19.318 INFO:teuthology.lock.ops:Node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging is complete 2022-04-01T06:51:19.517 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 8.stream 2022-04-01T06:51:19.529 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of centos 8.stream 2022-04-01T06:51:19.913 INFO:teuthology.orchestra.console:Power off smithi101 2022-04-01T06:51:19.929 INFO:teuthology.orchestra.console:Power off smithi039 2022-04-01T06:51:28.284 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2022-04-01T06:51:28.386 INFO:teuthology.orchestra.console:Power on smithi101 2022-04-01T06:51:32.403 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2022-04-01T06:51:32.505 INFO:teuthology.orchestra.console:Power on smithi039 2022-04-01T06:51:32.637 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2022-04-01T06:51:32.738 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2022-04-01T06:51:36.760 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2022-04-01T06:51:36.861 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2022-04-01T06:55:36.732 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-01T06:56:01.788 INFO:teuthology.provision.fog.smithi101:Node is ready 2022-04-01T06:56:01.811 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2022-04-01T06:56:01.869 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2022-04-01T06:56:02.238 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2022-04-01T06:57:03.343 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-01T06:57:03.715 INFO:teuthology.provision.fog.smithi039:Node is ready 2022-04-01T06:57:03.733 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2022-04-01T06:57:03.792 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2022-04-01T06:57:04.140 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2022-04-01T06:57:04.290 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2022-04-01T06:57:04.291 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-01T06:57:04.310 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2022-04-01T06:57:04.310 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-01T06:57:04.327 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2022-04-01T06:57:04.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2022-04-01T06:57:04.519 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2022-04-01T06:57:04.576 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2022-04-01T06:57:04.576 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8" 2022-04-01T06:57:04.577 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2022-04-01T06:57:04.577 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2022-04-01T06:57:04.577 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8" 2022-04-01T06:57:04.577 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2022-04-01T06:57:04.577 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-01T06:57:04.578 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2022-04-01T06:57:04.578 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-01T06:57:04.578 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2022-04-01T06:57:04.578 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-01T06:57:04.579 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-01T06:57:04.579 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-01T06:57:04.580 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2022-04-01T06:57:04.636 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2022-04-01T06:57:04.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2022-04-01T06:57:04.877 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2022-04-01T06:57:04.933 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Stream" 2022-04-01T06:57:04.934 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8" 2022-04-01T06:57:04.934 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos" 2022-04-01T06:57:04.934 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora" 2022-04-01T06:57:04.934 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8" 2022-04-01T06:57:04.935 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2022-04-01T06:57:04.935 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-01T06:57:04.935 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2022-04-01T06:57:04.935 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-01T06:57:04.935 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/" 2022-04-01T06:57:04.936 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-01T06:57:04.936 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-01T06:57:04.936 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-01T06:57:04.937 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2022-04-01T06:57:05.031 INFO:teuthology.dispatcher.supervisor:Running job 6770901 2022-04-01T06:57:05.032 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-04-01_01:23:52-rados-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6770901 --name yuriw-2022-04-01_01:23:52-rados-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/yuriw-2022-04-01_01:23:52-rados-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6770901/orig.config.yaml 2022-04-01T06:57:05.035 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-04-01_01:23:52-rados-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6770901 2022-04-01T06:57:05.036 INFO:teuthology.dispatcher.supervisor:Job PID: 29062 2022-04-01T06:57:05.037 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-01T13:27:33.140 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-01T13:27:33.283 INFO:teuthology.kill:Killing Pids: {29062} 2022-04-01T13:27:34.480 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-04-01T13:27:34.481 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-04-01T13:27:34.482 INFO:teuthology.misc:Compressing logs... 2022-04-01T13:27:34.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2022-04-01T13:27:34.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2022-04-01T13:27:35.003 INFO:teuthology.misc:Compressing logs... 2022-04-01T13:27:35.592 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-04-01T13:27:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-04-01T13:27:35.981 INFO:teuthology.misc:Compressing logs... 2022-04-01T13:28:05.250 INFO:teuthology.kill:No teuthology processes running 2022-04-01T13:28:06.386 INFO:teuthology.kill:Nuking machines: ['smithi039', 'smithi101'] 2022-04-01T13:28:07.433 INFO:teuthology.kill:2022-04-01 13:28:07,432.432 INFO:teuthology.nuke:targets: 2022-04-01T13:28:07.434 INFO:teuthology.kill: smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIdPdyy16+ep/G0e83cRWx4MkZJpopuI5vGjVQ9aR510od1VvETR85GiKagfQeRiBG6CJ9AidM8AfOmi2SA8Hnx0ZRX/9Aa+h5Dt5u3RNKCB3P6CIt3qAMTd98IFcZpuhNa9Qoii0IjFjulzKJ1bMQ1B71mAhuWIYtbqKVwAFO+XmjS3VMUgjKPhNI3xEYHDwkMI9BH0N/Auw4R2uJcpWHxlZ1k07Jdv7u07BeCjzq9ZHP56JvC7bsAHNLRvnwBdIq7+Jcdj8bEzScTY7J7WSc8Tfko3jOJyPHMUqXhwrX3FQDmwaLGeBk1w0RCzXPlqAyvbP2cw/mppECg4iBE2q7mIBejcPbkGFUBFR3FImyzkFNYh+jGwTOI0KPWUxqKZ32NBbxB79jj1N4t0PpZH3gPOb1WU31lWCWlrfn1xTI6iF8A0aCG8InQhpfF9KT9e9ITxkLbsJ3pquHrMNJYVfG1rdgkpqCITnXCBqorO03UiT6Exh5rjNjPlcLhMU9dK8= 2022-04-01T13:28:07.434 INFO:teuthology.kill: smithi101.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9Uu6kfG1aWKBLtEFuL/LxexyTFFUuRgjfiDsYBroTf5iAZNt4eyxopN23cgpEw5PHRRk1tnn+QSPOIxeH8e49oF2fwwtl94zYcU5a5DTxih0z8bqdrLHXnwH1ZZEhkiGof3PmPg5mR/AuMFBi35eT70hOqQdPmEdm2FHHmWPIWlHIzU0Dghr4mBWe0yxVDkL2QPg01IKIxcpu7hH9s/zllnvP08liAedVzpwXv4YRL9kPowMeoXctzz8SgPdvnb/G1nSyRwRnS2s6jnNGq7AKW74Nb0XEDgQ6VAozcpQn1I5K5UVuzVFwdphW89I/4YI4IIMxKaT62tRNpZJy/HoKzPxJyJSr0ALiCAZfBkrej53hraCESSJ2ga5XGGOs6Rou/bZ4xvU4zg6kIXmcs3wvAopwImZdLCUtFhIKDufowWDGwcrlUycUsiVdwR2cnpfB7l0FiMlbPHywZfcJMzDCdkyPxntEA5HPOUmhinKt6ngrNADAHgQDAY+VN3F+Q7c= 2022-04-01T13:28:07.460 INFO:teuthology.kill:2022-04-01 13:28:07,459.459 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-01T13:28:07.463 INFO:teuthology.kill:2022-04-01 13:28:07,463.463 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-01T13:28:07.535 INFO:teuthology.kill:2022-04-01 13:28:07,535.535 INFO:teuthology.orchestra.console:Power off smithi039 2022-04-01T13:28:07.549 INFO:teuthology.kill:2022-04-01 13:28:07,549.549 INFO:teuthology.orchestra.console:Power off smithi101 2022-04-01T13:28:15.907 INFO:teuthology.kill:2022-04-01 13:28:15,906.906 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2022-04-01T13:28:15.913 INFO:teuthology.kill:2022-04-01 13:28:15,913.913 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2022-04-01T13:28:16.057 INFO:teuthology.kill:2022-04-01 13:28:16,056.056 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com 2022-04-01T13:28:16.062 INFO:teuthology.kill:2022-04-01 13:28:16,062.062 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2022-04-01T13:30:16.333 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-01T13:30:16.432 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi039 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-01_01:33:15-rbd-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6771323 2022-04-01T13:30:16.432 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi101 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-01_01:33:15-rbd-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6771323