2022-04-08T18:12:51.404 INFO:root:teuthology version: 1.1.0-a347b2ac 2022-04-08T18:12:51.521 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging 2022-04-08T18:12:51.522 INFO:teuthology.lock.ops:Updating [ubuntu@smithi006.front.sepia.ceph.com]: reset os type and version on server 2022-04-08T18:12:51.522 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2022-04-08T18:12:51.540 INFO:teuthology.lock.ops:Node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging is complete 2022-04-08T18:12:51.540 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging 2022-04-08T18:12:51.541 INFO:teuthology.lock.ops:Updating [ubuntu@smithi085.front.sepia.ceph.com]: reset os type and version on server 2022-04-08T18:12:51.541 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-04-08T18:12:51.559 INFO:teuthology.lock.ops:Node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging is complete 2022-04-08T18:12:51.751 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 8.stream 2022-04-08T18:12:51.762 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of centos 8.stream 2022-04-08T18:12:52.067 INFO:teuthology.orchestra.console:Power off smithi006 2022-04-08T18:12:52.102 INFO:teuthology.orchestra.console:Power off smithi085 2022-04-08T18:13:04.578 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2022-04-08T18:13:04.582 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-04-08T18:13:04.680 INFO:teuthology.orchestra.console:Power on smithi006 2022-04-08T18:13:04.687 INFO:teuthology.orchestra.console:Power on smithi085 2022-04-08T18:13:13.048 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2022-04-08T18:13:13.054 INFO:teuthology.orchestra.console:Power on for smithi085 completed 2022-04-08T18:13:13.150 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2022-04-08T18:13:13.156 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish 2022-04-08T18:17:48.434 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-08T18:17:48.851 INFO:teuthology.provision.fog.smithi006:Node is ready 2022-04-08T18:17:48.869 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2022-04-08T18:17:48.929 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2022-04-08T18:17:49.280 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2022-04-08T18:17:57.487 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-08T18:17:57.754 INFO:teuthology.provision.fog.smithi085:Node is ready 2022-04-08T18:17:57.773 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com 2022-04-08T18:17:57.832 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085 2022-04-08T18:17:58.181 INFO:teuthology.provision.fog.smithi085:Deploy complete! 2022-04-08T18:17:58.350 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2022-04-08T18:17:58.351 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-08T18:17:58.372 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com 2022-04-08T18:17:58.372 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-08T18:17:58.394 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2022-04-08T18:17:58.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2022-04-08T18:17:58.594 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2022-04-08T18:17:58.654 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2022-04-08T18:17:58.654 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2022-04-08T18:17:58.655 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2022-04-08T18:17:58.655 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2022-04-08T18:17:58.655 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2022-04-08T18:17:58.655 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2022-04-08T18:17:58.656 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-08T18:17:58.656 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2022-04-08T18:17:58.656 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-08T18:17:58.656 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2022-04-08T18:17:58.656 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-08T18:17:58.657 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-08T18:17:58.657 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-08T18:17:58.658 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2022-04-08T18:17:58.680 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server 2022-04-08T18:17:58.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-04-08T18:17:58.878 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2022-04-08T18:17:58.936 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="CentOS Stream" 2022-04-08T18:17:58.937 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8" 2022-04-08T18:17:58.937 INFO:teuthology.orchestra.run.smithi085.stdout:ID="centos" 2022-04-08T18:17:58.937 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="rhel fedora" 2022-04-08T18:17:58.937 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8" 2022-04-08T18:17:58.938 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8" 2022-04-08T18:17:58.938 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-08T18:17:58.938 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31" 2022-04-08T18:17:58.938 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-08T18:17:58.938 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://centos.org/" 2022-04-08T18:17:58.939 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-08T18:17:58.939 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-08T18:17:58.939 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-08T18:17:58.940 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-04-08T18:17:59.031 INFO:teuthology.dispatcher.supervisor:Running job 6782896 2022-04-08T18:17:59.031 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2022-04-08_17:53:56-rados-wip-yuri5-testing-2022-04-05-1720-distro-basic-smithi/6782896 --name nojha-2022-04-08_17:53:56-rados-wip-yuri5-testing-2022-04-05-1720-distro-basic-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/nojha-2022-04-08_17:53:56-rados-wip-yuri5-testing-2022-04-05-1720-distro-basic-smithi/6782896/orig.config.yaml 2022-04-08T18:17:59.035 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2022-04-08_17:53:56-rados-wip-yuri5-testing-2022-04-05-1720-distro-basic-smithi/6782896 2022-04-08T18:17:59.036 INFO:teuthology.dispatcher.supervisor:Job PID: 5677 2022-04-08T18:17:59.037 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-09T00:48:27.487 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-09T00:48:27.669 INFO:teuthology.kill:Killing Pids: {5677} 2022-04-09T00:48:28.860 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-04-09T00:48:28.861 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-04-09T00:48:28.861 INFO:teuthology.misc:Compressing logs... 2022-04-09T00:48:28.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2022-04-09T00:48:29.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-04-09T00:48:29.369 INFO:teuthology.misc:Compressing logs... 2022-04-09T00:48:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-04-09T00:48:30.025 INFO:teuthology.orchestra.run.smithi085.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-04-09T00:48:30.387 INFO:teuthology.misc:Compressing logs... 2022-04-09T00:49:00.290 INFO:teuthology.kill:No teuthology processes running 2022-04-09T00:49:01.379 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi085'] 2022-04-09T00:49:02.353 INFO:teuthology.kill:2022-04-09 00:49:02,352.352 INFO:teuthology.nuke:targets: 2022-04-09T00:49:02.354 INFO:teuthology.kill: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0TJ5T1Dkzl3sFYS2VCwY2pFW6MAunBycnDzShSgfpeO8lLnmjglJqg0b/kFLIbxxvEB++oiuRW/n/Od0bDOhaQuD59MxM27Z+4EWC5cmbbBS4SISnmiSFakGDcSSoYfYte88Dw7VH28+pXJAJciei63Kouf8OVGF8k1tiW+F0qhcGOjfrW9V1PVdI6OuZduxfLZmJbacSC7Hi5uFwV9s6bu2a77mNNZv2Wvov2qYXwPz6oPSKyWitRP4jrmEGLXbriq5PcakoKTRXin7fKKcz4cODIQLmMIGtRm40wj+KKIh7RwR6zE3JdjYrBUVs2WeRCzTRcJ5MXZXvRgzHaNVqvloNhS4fera3skmAI7dhmlQG9hjKGMJvxUhpBmSU7Jmiqrm0qzMxhzZx4OiVL4ElRp1cbkIQ2FkCuDQaLoOOIjotsQC3sI12ePoVfhRH6imITevRV37N8mQZMEvIvanZSYyU4aF7ZtMBrHMH/n3u60+qOaDVw7ZKiobRRcFDid8= 2022-04-09T00:49:02.354 INFO:teuthology.kill: smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFmkWOUmmTepZf1KCfIpxI8OtxD1DW5A2qukMD1YWUtR06WXwqH3LyWiuzIo2FrNcD0LgfhPJCCQ5AJwfVMonrOcs6+oWH110TDtNK+UucTNl8GtB5NaO8o8DCjD/3Q6RWAChh2A1Nm9e/ZbJqPjn36S2EQvGZXpNarStOHr6tAxRYN3dE25cBlNwD8rri3RLMKPvfjNa0SViTIQ8ZPYcY+OquMU+g50voUlYegZgu0uVOQWHxrwMQdcVBcQKBmiA6CJJ5n+BcNRpSF7CXcMnfuMgQdF+YDUg7WoQthwfAUHF8qyXjWlq8tmEiCmIIRtXAJD/ltjCn0OPZ6VkKuja2T5iiw60e9btff24rIzzcij4m/NwDHzJbTbmCxWrJoemBLPriWEvDARNcweLrqL4fd33wabEk1nSrPitPelz4p1Jt1nyIVkZ9NUx/gWF6lF2qB6YTKxs93WIKKrnBiP3X8KbavAPF4JKCMu2hIddgo04FjFDIyE8doW/QHnC6L7E= 2022-04-09T00:49:02.379 INFO:teuthology.kill:2022-04-09 00:49:02,379.379 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-09T00:49:02.382 INFO:teuthology.kill:2022-04-09 00:49:02,382.382 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-09T00:49:02.454 INFO:teuthology.kill:2022-04-09 00:49:02,454.454 INFO:teuthology.orchestra.console:Power off smithi085 2022-04-09T00:49:02.467 INFO:teuthology.kill:2022-04-09 00:49:02,467.467 INFO:teuthology.orchestra.console:Power off smithi006 2022-04-09T00:49:10.827 INFO:teuthology.kill:2022-04-09 00:49:10,826.826 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-04-09T00:49:10.833 INFO:teuthology.kill:2022-04-09 00:49:10,833.833 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2022-04-09T00:49:10.977 INFO:teuthology.kill:2022-04-09 00:49:10,977.977 INFO:teuthology.lock.ops:unlocked: smithi085.front.sepia.ceph.com 2022-04-09T00:49:10.981 INFO:teuthology.kill:2022-04-09 00:49:10,980.980 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2022-04-09T00:51:11.286 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-09T00:51:11.389 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi006 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-04-08_23:03:08-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6783091 2022-04-09T00:51:11.390 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi085 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-04-08_23:03:08-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6783091