2021-11-19T21:11:58.142 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-19T21:11:58.263 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging 2021-11-19T21:11:58.264 INFO:teuthology.lock.ops:Updating [ubuntu@smithi105.front.sepia.ceph.com]: reset os type and version on server 2021-11-19T21:11:58.264 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2021-11-19T21:11:58.290 INFO:teuthology.lock.ops:Node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging is complete 2021-11-19T21:11:58.290 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging 2021-11-19T21:11:58.291 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server 2021-11-19T21:11:58.292 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2021-11-19T21:11:58.316 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete 2021-11-19T21:11:58.518 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.3 2021-11-19T21:11:58.521 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.3 2021-11-19T21:11:58.951 INFO:teuthology.orchestra.console:Power off smithi142 2021-11-19T21:11:58.965 INFO:teuthology.orchestra.console:Power off smithi105 2021-11-19T21:11:59.095 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2021-11-19T21:11:59.105 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2021-11-19T21:11:59.196 INFO:teuthology.orchestra.console:Power on smithi142 2021-11-19T21:11:59.206 INFO:teuthology.orchestra.console:Power on smithi105 2021-11-19T21:12:03.457 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2021-11-19T21:12:03.558 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2021-11-19T21:12:07.662 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2021-11-19T21:12:07.764 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2021-11-19T21:16:53.539 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-19T21:16:53.825 INFO:teuthology.provision.fog.smithi105:Node is ready 2021-11-19T21:16:53.880 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2021-11-19T21:16:53.936 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2021-11-19T21:16:54.252 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2021-11-19T21:16:57.705 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-19T21:16:57.996 INFO:teuthology.provision.fog.smithi142:Node is ready 2021-11-19T21:16:58.011 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2021-11-19T21:16:58.066 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2021-11-19T21:16:58.394 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2021-11-19T21:16:58.546 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2021-11-19T21:16:58.547 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-19T21:16:58.567 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2021-11-19T21:16:58.567 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-19T21:16:58.586 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2021-11-19T21:16:58.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2021-11-19T21:16:58.856 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2021-11-19T21:16:58.910 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux" 2021-11-19T21:16:58.910 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2021-11-19T21:16:58.910 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2021-11-19T21:16:58.911 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2021-11-19T21:16:58.911 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2021-11-19T21:16:58.911 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2021-11-19T21:16:58.911 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-19T21:16:58.912 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2021-11-19T21:16:58.912 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-19T21:16:58.912 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2021-11-19T21:16:58.912 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-19T21:16:58.913 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-19T21:16:58.913 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-19T21:16:58.914 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2021-11-19T21:16:58.933 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2021-11-19T21:16:58.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2021-11-19T21:16:59.194 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2021-11-19T21:16:59.248 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Linux" 2021-11-19T21:16:59.249 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2021-11-19T21:16:59.249 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2021-11-19T21:16:59.249 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2021-11-19T21:16:59.249 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2021-11-19T21:16:59.250 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2021-11-19T21:16:59.250 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-19T21:16:59.250 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2021-11-19T21:16:59.250 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-19T21:16:59.251 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2021-11-19T21:16:59.251 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-19T21:16:59.251 INFO:teuthology.orchestra.run.smithi142.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-19T21:16:59.251 INFO:teuthology.orchestra.run.smithi142.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-19T21:16:59.252 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2021-11-19T21:16:59.354 INFO:teuthology.dispatcher.supervisor:Running job 6514404 2021-11-19T21:16:59.355 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2021-11-19_19:14:07-rados-wip-autoscale-profile-scale-up-default-distro-basic-smithi/6514404 --name ksirivad-2021-11-19_19:14:07-rados-wip-autoscale-profile-scale-up-default-distro-basic-smithi --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} -- /home/teuthworker/archive/ksirivad-2021-11-19_19:14:07-rados-wip-autoscale-profile-scale-up-default-distro-basic-smithi/6514404/orig.config.yaml 2021-11-19T21:16:59.358 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2021-11-19_19:14:07-rados-wip-autoscale-profile-scale-up-default-distro-basic-smithi/6514404 2021-11-19T21:16:59.359 INFO:teuthology.dispatcher.supervisor:Job PID: 24756 2021-11-19T21:16:59.360 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-20T09:17:54.191 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-20T09:17:54.391 INFO:teuthology.kill:Killing Pids: {24756} 2021-11-20T09:17:55.618 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-11-20T09:17:55.619 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-11-20T09:17:55.619 INFO:teuthology.misc:Compressing logs... 2021-11-20T09:17:55.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2021-11-20T09:17:55.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2021-11-20T09:17:56.200 INFO:teuthology.misc:Compressing logs... 2021-11-20T09:17:57.166 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-11-20T09:17:57.489 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-11-20T09:17:58.140 INFO:teuthology.misc:Compressing logs... 2021-11-20T09:18:10.292 INFO:teuthology.kill:No teuthology processes running 2021-11-20T09:18:11.453 INFO:teuthology.kill:Nuking machines: ['smithi105', 'smithi142'] 2021-11-20T09:18:12.477 INFO:teuthology.kill:2021-11-20 09:18:12,477.477 INFO:teuthology.nuke:targets: 2021-11-20T09:18:12.478 INFO:teuthology.kill: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW60wjoBZecmXrsh8e/BXEu/+9Y9cEYHyBqoULc/XjFQGW0OAvWUQ+/gQCsImcclzDcni+Nqt1xI40VHEHL3poLe0i4nxwvD88N7yjFE4+Kb7dqoJL29qICAHEGGfHGvisR16K4/nn2yS6MRDOricc7VHhDX1kJJdsV+mgitUpd7PzwYRBBTSMsHYQs8oD0/xAOkyq08th83MlvdWRn9My5eZWwXj1iH35N56Uxc8e1mnD5l+1DxykKYWK7uHZ6issQCvg97K32uhdogYgtB+JX8WAAm7iq53yuLVrqtrgx0eIeawnsCir5u08imCrJCOnMsd1eEg4JCCRCFpKcJRj1soFm+H6nhy4b+2M5LjZB9Trgp0CbP9Qwxq3zzrqniFfjtFwdDYKO4tpdMEHFRqxPnrgBVSLIVtF5izFGpuhHQuXSx22xfdL2UhKUdWtsxnGg4um3RW1mpaqZNuHgTkECiI4ozTHhaYtjK0DE5d2PdIxhvDC15c6JGa6spWAJws= 2021-11-20T09:18:12.478 INFO:teuthology.kill: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaRqVdKKV7cGLOFZaNv3NLnVa+2IU0W245DBqxbspmzlcWnhBvvK7ZI6pqmbCYpsXFiKDPYW3CmeX7OnVC+Bw6xJFHE290P30eGF3lWSJafw+iEYxWsCvMbdLRzzWDSkQRb+sfwvCupq82dPyC8mA7mf+h9hHQv7MBLWAeKMgr2bGkMMAUEmzLfD/1fczMXKOpUbajJEr/4dbr9WbltBTc5vXEVkGmMzlLGirA9Jc+D7lrGjAerrJzE7aJtcwynSiw45tDzTel1/b1wbHamKtNMZWzGg5Jku5v9eWuNYghow8CVtyZUPD7LwpB0zGqCcp5XNwIcG+oQo2W7+Yg6dctjLVgOXS3Ul8R8p1A0AihXporQVcQUu4Pg9yl0j1rMREAi7HZWQVU//kYPdU5OFqbQSqS5pHvj30C+15hYDgOr41XCaO9fIaHkhvpvx8B9YFMTB2M5vQJZuFd7dRtGnOUcQw+hoG8gillAWPuNTLSAWNzZacA48YEbsmU6Iq5m7k= 2021-11-20T09:18:12.504 INFO:teuthology.kill:2021-11-20 09:18:12,504.504 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-20T09:18:12.509 INFO:teuthology.kill:2021-11-20 09:18:12,509.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-20T09:18:12.587 INFO:teuthology.kill:2021-11-20 09:18:12,586.586 INFO:teuthology.orchestra.console:Power off smithi142 2021-11-20T09:18:12.604 INFO:teuthology.kill:2021-11-20 09:18:12,603.603 INFO:teuthology.orchestra.console:Power off smithi105 2021-11-20T09:18:20.960 INFO:teuthology.kill:2021-11-20 09:18:20,960.960 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2021-11-20T09:18:21.107 INFO:teuthology.kill:2021-11-20 09:18:21,106.106 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2021-11-20T09:18:25.081 INFO:teuthology.kill:2021-11-20 09:18:25,081.081 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2021-11-20T09:18:25.229 INFO:teuthology.kill:2021-11-20 09:18:25,229.229 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2021-11-20T09:20:25.589 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-20T09:20:25.696 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/rfriedma-2021-11-20_08:01:54-rados-wip-rf-log-options-distro-basic-smithi/6515799 2021-11-20T09:20:25.697 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/rfriedma-2021-11-20_08:01:54-rados-wip-rf-log-options-distro-basic-smithi/6515799