2021-11-26T20:58:14.219 INFO:root:teuthology version: 1.1.0-a0bc3188 2021-11-26T20:58:14.359 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging 2021-11-26T20:58:14.360 INFO:teuthology.lock.ops:Updating [ubuntu@smithi078.front.sepia.ceph.com]: reset os type and version on server 2021-11-26T20:58:14.360 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2021-11-26T20:58:14.388 INFO:teuthology.lock.ops:Node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging is complete 2021-11-26T20:58:14.389 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi122.front.sepia.ceph.com' reimaging 2021-11-26T20:58:14.389 INFO:teuthology.lock.ops:Updating [ubuntu@smithi122.front.sepia.ceph.com]: reset os type and version on server 2021-11-26T20:58:14.390 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2021-11-26T20:58:14.410 INFO:teuthology.lock.ops:Node 'ubuntu@smithi122.front.sepia.ceph.com' reimaging is complete 2021-11-26T20:58:14.631 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 8.3 2021-11-26T20:58:14.641 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 8.3 2021-11-26T20:58:15.051 INFO:teuthology.orchestra.console:Power off smithi122 2021-11-26T20:58:15.095 INFO:teuthology.orchestra.console:Power off smithi078 2021-11-26T20:58:23.463 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2021-11-26T20:58:23.564 INFO:teuthology.orchestra.console:Power on smithi078 2021-11-26T20:58:27.545 INFO:teuthology.orchestra.console:Power off for smithi122 completed 2021-11-26T20:58:27.647 INFO:teuthology.orchestra.console:Power on smithi122 2021-11-26T20:58:27.818 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2021-11-26T20:58:27.920 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2021-11-26T20:58:36.027 INFO:teuthology.orchestra.console:Power on for smithi122 completed 2021-11-26T20:58:36.128 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2021-11-26T21:02:48.056 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-26T21:03:03.135 INFO:teuthology.provision.fog.smithi122:Node is ready 2021-11-26T21:03:03.153 INFO:teuthology.orchestra.run.smithi122.stdout:smithi133 2021-11-26T21:03:03.210 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2021-11-26T21:03:03.556 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2021-11-26T21:03:17.437 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-26T21:03:17.761 INFO:teuthology.provision.fog.smithi078:Node is ready 2021-11-26T21:03:17.818 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2021-11-26T21:03:17.875 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2021-11-26T21:03:18.203 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2021-11-26T21:03:18.390 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2021-11-26T21:03:18.391 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-26T21:03:18.409 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2021-11-26T21:03:18.409 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-26T21:03:18.430 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2021-11-26T21:03:18.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2021-11-26T21:03:18.641 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2021-11-26T21:03:18.696 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Linux" 2021-11-26T21:03:18.697 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8" 2021-11-26T21:03:18.697 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2021-11-26T21:03:18.697 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2021-11-26T21:03:18.697 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8" 2021-11-26T21:03:18.698 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2021-11-26T21:03:18.698 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-26T21:03:18.699 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2021-11-26T21:03:18.700 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-26T21:03:18.700 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2021-11-26T21:03:18.700 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-26T21:03:18.700 INFO:teuthology.orchestra.run.smithi078.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-26T21:03:18.701 INFO:teuthology.orchestra.run.smithi078.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-26T21:03:18.702 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2021-11-26T21:03:18.720 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2021-11-26T21:03:18.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2021-11-26T21:03:18.996 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2021-11-26T21:03:19.051 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Linux" 2021-11-26T21:03:19.052 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8" 2021-11-26T21:03:19.052 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2021-11-26T21:03:19.052 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2021-11-26T21:03:19.052 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8" 2021-11-26T21:03:19.052 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8" 2021-11-26T21:03:19.053 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-26T21:03:19.053 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2021-11-26T21:03:19.053 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-26T21:03:19.053 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2021-11-26T21:03:19.054 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-26T21:03:19.054 INFO:teuthology.orchestra.run.smithi122.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-26T21:03:19.054 INFO:teuthology.orchestra.run.smithi122.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-26T21:03:19.055 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2021-11-26T21:03:19.150 INFO:teuthology.dispatcher.supervisor:Running job 6528721 2021-11-26T21:03:19.150 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a0bc318848afe71da1fbf34e1e1b44738d8e3d6d/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-11-26_15:35:27-rados-wip-sage4-testing-2021-11-25-1626-distro-basic-smithi/6528721 --name sage-2021-11-26_15:35:27-rados-wip-sage4-testing-2021-11-25-1626-distro-basic-smithi --description rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/snaps-few-objects} -- /home/teuthworker/archive/sage-2021-11-26_15:35:27-rados-wip-sage4-testing-2021-11-25-1626-distro-basic-smithi/6528721/orig.config.yaml 2021-11-26T21:03:19.153 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-11-26_15:35:27-rados-wip-sage4-testing-2021-11-25-1626-distro-basic-smithi/6528721 2021-11-26T21:03:19.154 INFO:teuthology.dispatcher.supervisor:Job PID: 11265 2021-11-26T21:03:19.154 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-27T09:04:14.961 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-27T09:04:15.143 INFO:teuthology.kill:Killing Pids: {11265} 2021-11-27T09:04:16.373 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2021-11-27T09:04:16.374 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2021-11-27T09:04:16.374 INFO:teuthology.misc:Compressing logs... 2021-11-27T09:04:16.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2021-11-27T09:04:16.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2021-11-27T09:04:17.055 INFO:teuthology.misc:Compressing logs... 2021-11-27T09:04:17.207 INFO:teuthology.misc:Compressing logs... 2021-11-27T09:04:35.437 INFO:teuthology.kill:No teuthology processes running 2021-11-27T09:04:36.559 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi122'] 2021-11-27T09:04:37.555 INFO:teuthology.kill:2021-11-27 09:04:37,555.555 INFO:teuthology.nuke:targets: 2021-11-27T09:04:37.556 INFO:teuthology.kill: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGFsmuVNEowUidFe+zwnjbFgE3psfehxcJElv+XrX0ByuK29T5gfKac7m2Ch6uxvpmaHLaAzg/zS1N+bHKJbFcgEllRCtUSKoXsYgOkxutZ3gSgPqwBda63+rlK3dKMmhkad/OPIiW63L5Eu7L3dOzLnOZx7bFoQZqG5Ve0/f9y/YkAhLdUIgkexfEw+ZyG2btjUvgtLyIu4IjUkoXeH3uGWHrhRnnjIg+K5CS4RdYvr/c7CwuVoMDJ54+8ovSxReW8XexSxHtumoSfmVQL07Xz/UAxbsN/2KrTCILRD6SlHn5/YAUz29DcAFCDgwWzHt9IYArVt37AB1HdwRM83uuU8bdZhLe0zWkPYrde9yVp2uJKnFt5N2JEA5Unk8eoWfnWzd00xv5PKfrPuYkDL4FZAkj8+PG52qtfKVMkHKgHR4dm/3sgzYpHYPX9zHyA5tFerb2Et+xnK37t8VmrPxBna7pSGxhxghBt8Rg8S22uKsisW4kSp4G6VkjVNtNh4U= 2021-11-27T09:04:37.557 INFO:teuthology.kill: smithi122.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiHP2wDzwUW+46f0Ly3waW4yyPv1yxpsFaVPT+F8UntwnQgJO3RKyw5J/OD2sAMwcsEXncOzN3Yssm6+kDb5ENlyyh/WoRYgYmycYid2HEuzIYwMMOnPTM19tiwpUWldvQZIFtIswsghR+a6p5TvCSArYjigzwfR5DkLCr+slXr2sAbk2ox+Ksp6vKmzooNHcI/QV9CUgjaSbD/s//BJBXUoRCKUACuuG0dbsX3pL656SY7JfcmfryKasUNzdMoURilqz+HmrZrXZ+rfhrZOJHrDpYxE/4qUUA8Qr6fL0vSE2MyNUpxxUg74Tky//W1rxE7ZmoSpN0O2fEVkWHZIb2A1ng/uaU3xIP38FqufL/0Y7G1XDvD2spMNMbCThFmPJdoY1n46WD2pWyyr5qjIn/ppyLQ3IOC7UeHgqqlqVgin0q7gH5BBwHuw+QhMXaobTxEtMgF0/coLJ6eOK8CXJXAdOTiHI3E94yhFJHRaPkG3GxTL3UYX0A7jkSlc0d6D0= 2021-11-27T09:04:37.583 INFO:teuthology.kill:2021-11-27 09:04:37,582.582 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-27T09:04:37.586 INFO:teuthology.kill:2021-11-27 09:04:37,586.586 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-27T09:04:37.663 INFO:teuthology.kill:2021-11-27 09:04:37,662.662 INFO:teuthology.orchestra.console:Power off smithi122 2021-11-27T09:04:37.676 INFO:teuthology.kill:2021-11-27 09:04:37,676.676 INFO:teuthology.orchestra.console:Power off smithi078 2021-11-27T09:04:50.148 INFO:teuthology.kill:2021-11-27 09:04:50,148.148 INFO:teuthology.orchestra.console:Power off for smithi122 completed 2021-11-27T09:04:50.155 INFO:teuthology.kill:2021-11-27 09:04:50,154.154 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2021-11-27T09:04:50.306 INFO:teuthology.kill:2021-11-27 09:04:50,305.305 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2021-11-27T09:04:50.308 INFO:teuthology.kill:2021-11-27 09:04:50,308.308 INFO:teuthology.lock.ops:unlocked: smithi122.front.sepia.ceph.com 2021-11-27T09:06:50.622 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-27T09:06:50.722 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi078 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-26_05:17:02-krbd-pacific-testing-default-smithi/6527928 2021-11-27T09:06:51.157 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi122 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-26_05:17:02-krbd-pacific-testing-default-smithi/6527929