2022-03-22T19:25:16.488 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-22T19:25:16.609 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging 2022-03-22T19:25:16.610 INFO:teuthology.lock.ops:Updating [ubuntu@smithi083.front.sepia.ceph.com]: reset os type and version on server 2022-03-22T19:25:16.610 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-03-22T19:25:16.629 INFO:teuthology.lock.ops:Node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging is complete 2022-03-22T19:25:16.629 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi135.front.sepia.ceph.com' reimaging 2022-03-22T19:25:16.630 INFO:teuthology.lock.ops:Updating [ubuntu@smithi135.front.sepia.ceph.com]: reset os type and version on server 2022-03-22T19:25:16.630 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2022-03-22T19:25:16.650 INFO:teuthology.lock.ops:Node 'ubuntu@smithi135.front.sepia.ceph.com' reimaging is complete 2022-03-22T19:25:16.863 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 8.stream 2022-03-22T19:25:16.891 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 8.stream 2022-03-22T19:25:17.294 INFO:teuthology.orchestra.console:Power off smithi083 2022-03-22T19:25:17.307 INFO:teuthology.orchestra.console:Power off smithi135 2022-03-22T19:25:25.670 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2022-03-22T19:25:25.771 INFO:teuthology.orchestra.console:Power on smithi135 2022-03-22T19:25:29.777 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2022-03-22T19:25:29.879 INFO:teuthology.orchestra.console:Power on smithi083 2022-03-22T19:25:34.132 INFO:teuthology.orchestra.console:Power on for smithi135 completed 2022-03-22T19:25:34.136 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2022-03-22T19:25:34.234 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2022-03-22T19:25:34.238 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2022-03-22T19:29:38.247 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-22T19:29:46.494 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-22T19:30:03.858 INFO:teuthology.provision.fog.smithi135:Node is ready 2022-03-22T19:30:03.881 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2022-03-22T19:30:03.939 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2022-03-22T19:30:04.316 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2022-03-22T19:30:11.775 INFO:teuthology.provision.fog.smithi083:Node is ready 2022-03-22T19:30:11.798 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2022-03-22T19:30:11.858 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2022-03-22T19:30:12.234 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2022-03-22T19:30:12.385 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2022-03-22T19:30:12.386 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-22T19:30:12.407 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2022-03-22T19:30:12.408 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-22T19:30:12.428 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2022-03-22T19:30:12.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2022-03-22T19:30:12.621 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2022-03-22T19:30:12.678 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2022-03-22T19:30:12.679 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8" 2022-03-22T19:30:12.679 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2022-03-22T19:30:12.679 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2022-03-22T19:30:12.680 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8" 2022-03-22T19:30:12.680 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2022-03-22T19:30:12.680 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-22T19:30:12.681 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2022-03-22T19:30:12.681 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-22T19:30:12.681 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2022-03-22T19:30:12.681 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-22T19:30:12.682 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-22T19:30:12.682 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-22T19:30:12.683 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-03-22T19:30:12.700 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2022-03-22T19:30:12.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2022-03-22T19:30:12.902 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2022-03-22T19:30:12.960 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2022-03-22T19:30:12.960 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2022-03-22T19:30:12.960 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2022-03-22T19:30:12.961 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2022-03-22T19:30:12.961 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2022-03-22T19:30:12.961 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2022-03-22T19:30:12.961 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-22T19:30:12.962 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2022-03-22T19:30:12.962 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-22T19:30:12.962 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2022-03-22T19:30:12.962 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-22T19:30:12.962 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-22T19:30:12.963 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-22T19:30:12.963 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2022-03-22T19:30:13.064 INFO:teuthology.dispatcher.supervisor:Running job 6753006 2022-03-22T19:30:13.065 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-22_14:10:35-rados-wip-yuri4-testing-2022-03-21-1648-pacific-distro-default-smithi/6753006 --name yuriw-2022-03-22_14:10:35-rados-wip-yuri4-testing-2022-03-21-1648-pacific-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/yuriw-2022-03-22_14:10:35-rados-wip-yuri4-testing-2022-03-21-1648-pacific-distro-default-smithi/6753006/orig.config.yaml 2022-03-22T19:30:13.068 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-22_14:10:35-rados-wip-yuri4-testing-2022-03-21-1648-pacific-distro-default-smithi/6753006 2022-03-22T19:30:13.069 INFO:teuthology.dispatcher.supervisor:Job PID: 1139 2022-03-22T19:30:13.069 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-03-23T02:00:42.127 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-03-23T02:00:42.367 INFO:teuthology.kill:Killing Pids: {1139} 2022-03-23T02:00:43.436 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-03-23T02:00:43.437 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-03-23T02:00:43.438 INFO:teuthology.misc:Compressing logs... 2022-03-23T02:00:43.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2022-03-23T02:00:43.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2022-03-23T02:00:43.998 INFO:teuthology.misc:Compressing logs... 2022-03-23T02:00:44.555 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-03-23T02:00:44.590 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-03-23T02:00:44.951 INFO:teuthology.misc:Compressing logs... 2022-03-23T02:01:17.350 INFO:teuthology.kill:No teuthology processes running 2022-03-23T02:01:18.435 INFO:teuthology.kill:Nuking machines: ['smithi083', 'smithi135'] 2022-03-23T02:01:19.430 INFO:teuthology.kill:2022-03-23 02:01:19,430.430 INFO:teuthology.nuke:targets: 2022-03-23T02:01:19.431 INFO:teuthology.kill: smithi083.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEggLqNwfubHl4NYO3Qv3++s08MQFfgTdA3QRtpNwa5o+vg3MW73aBB0t91JkcTKyVDEHKA9+bu9mx1NW/fiao7xTmhieC0M9OlkH/v5XvUciCzEJ0SPNzocjKLn+XY0Ns+2981Qpl6vI0byNuIMLGQ8KOFHtpmSko2x7PTAiu5+EXkJl4nCEal9YDGsdqUJPaDdRdr2FQaToEtZ2wQNPNnIOkcZx8Gvqu1r/iKE9stDleFAIjMPS/7VdVBqUO/vw/QhRh3rZ/T8EsHWC+xf4cEw+lemcVoUoA5QgqQ71hL8dMvZOZlW1GS++XpjifrXqyjHmZ/W+c4lQbdVt4IF7B3HjIRqlgGQZfvgEjWzOwFeBF/U3+/cv+n+ZlqJkA4TT6Szc5Oz/Q7DXasG9YY446G6rHH2g0BMa/e+RfKB6BKWOR5PYPRw+6+jQ3YDg5l5pl/l5xNtGNlK3BF0EqBPW06v1beK6HBl21GowKhaFfMbH7vOTmyPgjtLNj1eVEvv0= 2022-03-23T02:01:19.432 INFO:teuthology.kill: smithi135.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQem7qy3Pkz/xrd1hVGLa0gHt83JqHdm/JpRmeZGPC+r10rD05BWCBjlaGC74Dcg0rBhLUPS/gRKPEZjlH5Wa32+wJxwJao3AcK6rDVtMQjt8L55/UqmYmfMR2oSebQWf/V/ByEn/hTIrJU4Y26URbPPrQogy+N5AxF2PM4h+njxYwvXa7TRmNIWIGv7EcMGXfi1N3uggB36oxs3/DtbtklmkLYTp6CLpswRiVcOpnM842gLw5BikkPCULZ4G+T53lFbSDNhciTXqyKbBkIsG6l3IX+7vQ0ChpkSml3u2U/Qa8g05JPaxk+kDIzAfuOfQyXuEfPb6Co/qIecdr/Q1KhoOyV6sWguZ/QDl5Id3wq5MP4Sm1jzVBQrentd/0IzRZ/qV5z5r26Y2tk1Bu83XTLo4vJGLGrU2vZnSLfUpSpBPVueN7BxriWRpdN/VflwguoyZfMxoMtP3Xm8gq8yIRu4a8gsvGR8T/0+7HzcumtVc8vqJ874LmKiea+1d0JtU= 2022-03-23T02:01:19.455 INFO:teuthology.kill:2022-03-23 02:01:19,455.455 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-23T02:01:19.458 INFO:teuthology.kill:2022-03-23 02:01:19,458.458 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-23T02:01:19.525 INFO:teuthology.kill:2022-03-23 02:01:19,524.524 INFO:teuthology.orchestra.console:Power off smithi135 2022-03-23T02:01:19.537 INFO:teuthology.kill:2022-03-23 02:01:19,537.537 INFO:teuthology.orchestra.console:Power off smithi083 2022-03-23T02:01:27.891 INFO:teuthology.kill:2022-03-23 02:01:27,891.891 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2022-03-23T02:01:27.900 INFO:teuthology.kill:2022-03-23 02:01:27,899.899 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2022-03-23T02:01:28.038 INFO:teuthology.kill:2022-03-23 02:01:28,037.037 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com 2022-03-23T02:01:28.045 INFO:teuthology.kill:2022-03-23 02:01:28,045.045 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2022-03-23T02:03:28.307 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-03-23T02:03:28.429 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi083 but it was locked by another job: /home/teuthworker/archive/dis-2022-03-22_22:18:48-rbd-wip-dis-testing-2-distro-default-smithi/6754319