2022-02-10T08:10:22.892 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-10T08:10:23.009 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging 2022-02-10T08:10:23.011 INFO:teuthology.lock.ops:Updating [ubuntu@smithi006.front.sepia.ceph.com]: reset os type and version on server 2022-02-10T08:10:23.011 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2022-02-10T08:10:23.028 INFO:teuthology.lock.ops:Node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging is complete 2022-02-10T08:10:23.029 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi138.front.sepia.ceph.com' reimaging 2022-02-10T08:10:23.029 INFO:teuthology.lock.ops:Updating [ubuntu@smithi138.front.sepia.ceph.com]: reset os type and version on server 2022-02-10T08:10:23.030 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2022-02-10T08:10:23.048 INFO:teuthology.lock.ops:Node 'ubuntu@smithi138.front.sepia.ceph.com' reimaging is complete 2022-02-10T08:10:23.236 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 8.stream 2022-02-10T08:10:23.257 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.stream 2022-02-10T08:10:23.542 INFO:teuthology.orchestra.console:Power off smithi006 2022-02-10T08:10:23.558 INFO:teuthology.orchestra.console:Power off smithi138 2022-02-10T08:10:31.920 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2022-02-10T08:10:32.022 INFO:teuthology.orchestra.console:Power on smithi006 2022-02-10T08:10:36.038 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2022-02-10T08:10:36.140 INFO:teuthology.orchestra.console:Power on smithi138 2022-02-10T08:10:40.386 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2022-02-10T08:10:40.488 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2022-02-10T08:10:44.506 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2022-02-10T08:10:44.607 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2022-02-10T08:14:48.106 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-10T08:14:48.355 INFO:teuthology.provision.fog.smithi006:Node is ready 2022-02-10T08:14:48.373 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2022-02-10T08:14:48.431 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2022-02-10T08:14:48.781 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2022-02-10T08:14:50.803 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-10T08:15:16.517 INFO:teuthology.provision.fog.smithi138:Node is ready 2022-02-10T08:15:16.540 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2022-02-10T08:15:16.599 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2022-02-10T08:15:16.962 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2022-02-10T08:15:17.126 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2022-02-10T08:15:17.127 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-10T08:15:17.151 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2022-02-10T08:15:17.152 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-10T08:15:17.174 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2022-02-10T08:15:17.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2022-02-10T08:15:17.429 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2022-02-10T08:15:17.487 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2022-02-10T08:15:17.488 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2022-02-10T08:15:17.488 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2022-02-10T08:15:17.488 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2022-02-10T08:15:17.488 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2022-02-10T08:15:17.488 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2022-02-10T08:15:17.489 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-10T08:15:17.489 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2022-02-10T08:15:17.489 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-10T08:15:17.489 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2022-02-10T08:15:17.490 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-10T08:15:17.490 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-10T08:15:17.490 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-10T08:15:17.491 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2022-02-10T08:15:17.510 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2022-02-10T08:15:17.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2022-02-10T08:15:17.704 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2022-02-10T08:15:17.761 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2022-02-10T08:15:17.762 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8" 2022-02-10T08:15:17.762 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2022-02-10T08:15:17.763 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2022-02-10T08:15:17.763 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2022-02-10T08:15:17.763 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2022-02-10T08:15:17.763 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-10T08:15:17.764 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2022-02-10T08:15:17.764 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-10T08:15:17.765 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2022-02-10T08:15:17.765 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-10T08:15:17.765 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-10T08:15:17.765 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-10T08:15:17.767 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2022-02-10T08:15:17.863 INFO:teuthology.dispatcher.supervisor:Running job 6673190 2022-02-10T08:15:17.863 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-02-10_06:16:41-rados-master-distro-default-smithi/6673190 --name amathuri-2022-02-10_06:16:41-rados-master-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-02-10_06:16:41-rados-master-distro-default-smithi/6673190/orig.config.yaml 2022-02-10T08:15:17.867 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-02-10_06:16:41-rados-master-distro-default-smithi/6673190 2022-02-10T08:15:17.868 INFO:teuthology.dispatcher.supervisor:Job PID: 15102 2022-02-10T08:15:17.868 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-10T14:45:47.000 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-10T14:45:47.192 INFO:teuthology.kill:Killing Pids: {15102} 2022-02-10T14:45:48.455 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-02-10T14:45:48.456 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-02-10T14:45:48.456 INFO:teuthology.misc:Compressing logs... 2022-02-10T14:45:48.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2022-02-10T14:45:48.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2022-02-10T14:45:49.010 INFO:teuthology.misc:Compressing logs... 2022-02-10T14:45:49.367 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-02-10T14:45:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-02-10T14:45:49.661 INFO:teuthology.misc:Compressing logs... 2022-02-10T14:46:25.549 INFO:teuthology.kill:No teuthology processes running 2022-02-10T14:46:26.743 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi138'] 2022-02-10T14:46:27.753 INFO:teuthology.kill:2022-02-10 14:46:27,753.753 INFO:teuthology.nuke:targets: 2022-02-10T14:46:27.755 INFO:teuthology.kill: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCf7YKALoh+2aX1dicQJ+9cD8q5HrNy8RjhMO6EeZbbnbhUgAEZhKpo1wwuvISR3Q1XKS+uEWGE+CW5kV/fSnPFNq+hh/rsGdpMN8Dy2KzHEqI80DeO0uN0cfqRRmvjCnJ0Vbew3qpwVqoyQSTCsVMTYLvZlXLtz7thzzlwRpxqjYLtwkYVSGDpkIJT7gg+I5dUXGRi66aBLRdWFk6t/mmVLQ5m1hyqaoHSgH+6LFlEJWM8oEwl55uJi8BcfPpiuWkVkBNJzXRH0eipxOigRicD7lx08OSSEpLtVkoERjcmv3tHUUpOWO9a8H+62w0b//FGmdPPdHW88JD4rO4RODQ7vwn8ao3nVcLlOq781oDhvSZ+qQPli0Uc6VPT7nl/NUB+BklVXELmpFNTMZU/Zx7fcMrazhl/Ta+nAnGnrmnTZPWED2jUQg/17434iumxbpHgPfV6sdRFWzXXoqzPWk0rNS5DxDnLZiVuFlQ68TnpUcvg+68mwVgJ/Jt2aAZC/iE= 2022-02-10T14:46:27.755 INFO:teuthology.kill: smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxBSv7Wd9jM+mbqDeifn8perZEl07uKRvuvzBAoCe7sfuLqk1D5iLtYPNxeHs25jobIFmAx7p/cSWNo54shII8bAXMGCDDcu2+inUA/k4ViIYejb7ZEtqEJRzK+wLq58R5etF6C5ONdG0Ek/85r8TBfZx0U5zQGfzOcjglIV9ECmFVZ7XisNqqcZGe55jD5kFJsKPA91hFb4qyqcH2H08jTHgQQo28xU5KhxBwY3LDCTqXrm6NXTnhS4sBcEalboo9jKs4EAJQewIK6sGACPoJBJ+Sp9Vo2ejYRa3rbzEn5DrwYbTBuyFIB2erPsA7BPjnou05pXwrXFMGEka1GFkSIN5kUKb62aYpqS2qeKKXW8q0MT2/oLlSAJMdbmkSl2K0JI1YO5f/uP10z3PWBAMnKdjPSsmP5z1Em0gzwhybfB7QGL8poUsNBfZUy9tzM0WKPSeA1Tifq//wop7TnyrOwQvktdoH2O1SvvLJcaDNrzL/PfEGNwFdVyGHpN+/aTE= 2022-02-10T14:46:27.784 INFO:teuthology.kill:2022-02-10 14:46:27,784.784 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-10T14:46:27.789 INFO:teuthology.kill:2022-02-10 14:46:27,789.789 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-10T14:46:27.874 INFO:teuthology.kill:2022-02-10 14:46:27,874.874 INFO:teuthology.orchestra.console:Power off smithi138 2022-02-10T14:46:27.888 INFO:teuthology.kill:2022-02-10 14:46:27,888.888 INFO:teuthology.orchestra.console:Power off smithi006 2022-02-10T14:46:36.249 INFO:teuthology.kill:2022-02-10 14:46:36,249.249 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2022-02-10T14:46:36.264 INFO:teuthology.kill:2022-02-10 14:46:36,264.264 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2022-02-10T14:46:36.396 INFO:teuthology.kill:2022-02-10 14:46:36,395.395 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2022-02-10T14:46:36.407 INFO:teuthology.kill:2022-02-10 14:46:36,406.406 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2022-02-10T14:48:36.700 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-02-10T14:48:36.805 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi006 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-10_14:39:40-rados-wip-yuri-testing-2022-02-09-1607-distro-default-smithi/6673732 2022-02-10T14:48:36.806 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi138 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-10_14:39:40-rados-wip-yuri-testing-2022-02-09-1607-distro-default-smithi/6673733