2021-02-10T01:11:32.261 INFO:root:teuthology version: 1.1.0-17c09965
2021-02-10T01:11:32.361 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging
2021-02-10T01:11:32.361 INFO:teuthology.lock.ops:Updating [ubuntu@smithi131.front.sepia.ceph.com]: reset os type and version on server
2021-02-10T01:11:32.362 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2021-02-10T01:11:32.376 INFO:teuthology.lock.ops:Node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging is complete
2021-02-10T01:11:32.377 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging
2021-02-10T01:11:32.377 INFO:teuthology.lock.ops:Updating [ubuntu@smithi165.front.sepia.ceph.com]: reset os type and version on server
2021-02-10T01:11:32.377 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2021-02-10T01:11:32.391 INFO:teuthology.lock.ops:Node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging is complete
2021-02-10T01:11:32.608 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of rhel 8.3
2021-02-10T01:11:32.640 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of rhel 8.3
2021-02-10T01:11:33.076 INFO:teuthology.orchestra.console:Power off smithi131
2021-02-10T01:11:33.112 INFO:teuthology.orchestra.console:Power off smithi165
2021-02-10T01:11:41.476 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2021-02-10T01:11:41.577 INFO:teuthology.orchestra.console:Power on smithi165
2021-02-10T01:11:45.559 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2021-02-10T01:11:45.660 INFO:teuthology.orchestra.console:Power on smithi131
2021-02-10T01:11:49.920 INFO:teuthology.orchestra.console:Power on for smithi131 completed
2021-02-10T01:11:49.998 INFO:teuthology.orchestra.console:Power on for smithi165 completed
2021-02-10T01:11:50.022 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2021-02-10T01:11:50.099 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2021-02-10T01:16:11.353 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-10T01:16:21.787 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-10T01:16:22.084 INFO:teuthology.provision.fog.smithi131:Node is ready
2021-02-10T01:16:22.103 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2021-02-10T01:16:22.159 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2021-02-10T01:16:22.516 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2021-02-10T01:16:31.348 INFO:teuthology.provision.fog.smithi165:Node is ready
2021-02-10T01:16:31.367 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2021-02-10T01:16:31.423 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2021-02-10T01:16:31.788 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2021-02-10T01:16:31.913 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2021-02-10T01:16:31.914 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-10T01:16:31.930 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2021-02-10T01:16:31.930 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-10T01:16:31.944 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2021-02-10T01:16:31.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-10T01:16:32.239 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2021-02-10T01:16:32.293 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux"
2021-02-10T01:16:32.293 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.3 (Ootpa)"
2021-02-10T01:16:32.293 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel"
2021-02-10T01:16:32.293 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.3"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-10T01:16:32.294 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-10T01:16:32.296 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2021-02-10T01:16:32.310 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2021-02-10T01:16:32.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-10T01:16:32.589 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2021-02-10T01:16:32.643 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="Red Hat Enterprise Linux"
2021-02-10T01:16:32.643 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8.3 (Ootpa)"
2021-02-10T01:16:32.643 INFO:teuthology.orchestra.run.smithi165.stdout:ID="rhel"
2021-02-10T01:16:32.643 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="fedora"
2021-02-10T01:16:32.643 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8.3"
2021-02-10T01:16:32.643 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2021-02-10T01:16:32.643 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-10T01:16:32.643 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2021-02-10T01:16:32.644 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-10T01:16:32.644 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://www.redhat.com/"
2021-02-10T01:16:32.644 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-10T01:16:32.644 INFO:teuthology.orchestra.run.smithi165.stdout:
2021-02-10T01:16:32.644 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-10T01:16:32.644 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-10T01:16:32.644 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-10T01:16:32.644 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-10T01:16:32.645 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2021-02-10T01:16:32.724 INFO:teuthology.dispatcher.supervisor:Running job 5871621
2021-02-10T01:16:32.724 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology -v --owner scheduled_sseshasa@teuthology --archive /home/teuthworker/archive/sseshasa-2021-02-09_10:39:09-rados-wip-sseshasa-testing-2021-02-02-1136-distro-basic-smithi/5871621 --name sseshasa-2021-02-09_10:39:09-rados-wip-sseshasa-testing-2021-02-02-1136-distro-basic-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} -- /home/teuthworker/archive/sseshasa-2021-02-09_10:39:09-rados-wip-sseshasa-testing-2021-02-02-1136-distro-basic-smithi/5871621/orig.config.yaml
2021-02-10T01:16:32.728 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sseshasa-2021-02-09_10:39:09-rados-wip-sseshasa-testing-2021-02-02-1136-distro-basic-smithi/5871621
2021-02-10T01:16:32.728 INFO:teuthology.dispatcher.supervisor:Job PID: 30623
2021-02-10T01:16:32.728 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-10T13:16:49.158 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-10T13:16:49.354 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-02-10T13:16:49.355 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-02-10T13:16:49.355 INFO:teuthology.misc:Compressing logs...
2021-02-10T13:16:49.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-10T13:16:49.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-10T13:16:50.072 INFO:teuthology.misc:Compressing logs...
2021-02-10T13:16:50.811 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-02-10T13:16:51.211 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-02-10T13:18:05.556 INFO:teuthology.misc:Compressing logs...
2021-02-10T13:19:22.026 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ceph-osd.1.log: file size changed while zipping
2021-02-10T13:19:33.299 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/ceph-osd.5.log: file size changed while zipping
2021-02-10T13:19:36.030 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/ceph-mgr.x.log: file size changed while zipping
2021-02-10T13:20:48.148 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ceph-osd.3.log: file size changed while zipping
2021-02-10T13:20:55.095 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/ceph-osd.4.log: file size changed while zipping
2021-02-10T13:21:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/ceph-mon.b.log: file size changed while zipping
2021-02-10T13:21:25.932 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ceph-mon.a.log: file size changed while zipping
2021-02-10T13:21:44.425 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping
2021-02-10T13:21:56.989 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/ceph-mgr.y.log: file size changed while zipping
2021-02-10T13:22:41.912 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/ceph-osd.7.log: file size changed while zipping
2021-02-10T13:23:15.665 INFO:teuthology.orchestra.run.smithi131.stderr:tar: ./ceph-osd.3.log: file changed as we read it
2021-02-10T13:23:33.531 INFO:teuthology.orchestra.run.smithi131.stderr:tar: ./ceph-osd.1.log: file changed as we read it
2021-02-10T13:23:58.213 INFO:teuthology.orchestra.run.smithi131.stderr:tar: .: file changed as we read it
2021-02-10T13:23:59.255 INFO:teuthology.orchestra.run.smithi165.stderr:tar: ./ceph-osd.5.log: file changed as we read it
2021-02-10T13:24:18.260 INFO:teuthology.orchestra.run.smithi165.stderr:tar: ./ceph-osd.4.log: file changed as we read it
2021-02-10T13:24:41.186 INFO:teuthology.orchestra.run.smithi165.stderr:tar: ./ceph-osd.7.log: file changed as we read it
2021-02-10T13:24:59.577 INFO:teuthology.kill:Killing Pids: {30623}
2021-02-10T13:25:01.356 INFO:teuthology.kill:Nuking machines: ['smithi131', 'smithi165']
2021-02-10T13:25:02.928 INFO:teuthology.kill:2021-02-10 13:25:02,927.927 INFO:teuthology.nuke:targets:
2021-02-10T13:25:02.928 INFO:teuthology.kill:  smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgs3XNXx2nLYG1BFx+iGmsUimF4QZ/lyeCg1TcDeNzyJ8rh1sZs6X5y7+wILZHhgNXmiP96yPQTRhjqU4YUgi+3clrgGR9BHn3HM7ek1sN2quuFNNDgKYJiF3CltOpSPhlnCo5u93SFq6OE02uJXtn6Zmn5XY5OTNJeK5AYaoBB+Ay3GQBT3wm9bPzjScUK8/dHUE+LLcHxWK3lyMrUwY/y9BQWix+xgLBIWWaWlIr8HSfsjK7PYBgwOYsiV5PnejWamxtA2uvkxFUsqkGgJrdwRbYA5hFP9yf5sHDS7cCnScVD7+trRmhUsBc0v3TG0itR0D5Ccj+LiRtihQMHF4YuPoXGsWcmGoorr3ibhgWtfCJ2ZA4iKw/CYE850t3gKqE5s3xJgLO54r5a6aGXOXS+fYq0hfWel9sff3JbTCRR46OE5gXbuIMJ8EZbgrIyLFnVjQbDhNMx0isYUTP/casWNWgSc22+c3OddU1Cu8KhHkk9ZvZr2rMUPqorYZXYu0=
2021-02-10T13:25:02.928 INFO:teuthology.kill:  smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8wYwnb0qRz9CtBb/p5w/QUP45Nwl4sNdpfXxyBnhxJlE/vnqDuGoZTVNKnEKjHgbBE0Qqhqgr5BHgECW8InGbH6/hBanNqj8w5+1UudutXiDmLs0Ag5P0ACy26hYcn3zlNSiCW4MA8+iBYvd2KyDZzxOruK3Uj7K/PedZjluyiBQurWYDzmfCMmeWDJnyu8xpp0qHGaaOGMdVVPwVr4bkchmT3rslidRv28zaTmBTJw1n0nh1M+bxz33ik2vs28CN7U66Plu7VAdxO3SzXwNqLawFj/N33DjJGf952jJMEILneWXW9Ie7vQ1aK8ie/30XdoE85arIA9WHCrv5pyOnIiKvk2nPV8RgINNjz12ph+fL7tcu3g70bdx96VqQtnCNVHICD6DevDjgElFM+dhTemeAXekMzljPh6kPTXuTCwyiP+325F83s0JhrxXddfCsQhDimqB4NL4hjoJ31P/PgBlleaw8U2tcaz1Or/EVxZqj43/rMt2MGo3Kn1rOLQk=
2021-02-10T13:25:02.957 INFO:teuthology.kill:2021-02-10 13:25:02,956.956 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-10T13:25:02.960 INFO:teuthology.kill:2021-02-10 13:25:02,960.960 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-10T13:25:03.030 INFO:teuthology.kill:2021-02-10 13:25:03,029.029 INFO:teuthology.orchestra.console:Power off smithi131
2021-02-10T13:25:03.047 INFO:teuthology.kill:2021-02-10 13:25:03,047.047 INFO:teuthology.orchestra.console:Power off smithi165
2021-02-10T13:25:11.468 INFO:teuthology.kill:2021-02-10 13:25:11,468.468 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2021-02-10T13:25:11.608 INFO:teuthology.kill:2021-02-10 13:25:11,607.607 INFO:teuthology.lock.ops:unlocked smithi131.front.sepia.ceph.com
2021-02-10T13:25:15.589 INFO:teuthology.kill:2021-02-10 13:25:15,588.588 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2021-02-10T13:25:15.732 INFO:teuthology.kill:2021-02-10 13:25:15,732.732 INFO:teuthology.lock.ops:unlocked smithi165.front.sepia.ceph.com
2021-02-10T13:27:15.908 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-10T13:27:16.041 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-10T13:27:16.041 INFO:teuthology.nuke:Checking targets against current locks
2021-02-10T13:27:16.116 INFO:teuthology.nuke:Not nuking smithi131.front.sepia.ceph.com because description doesn't match
2021-02-10T13:27:16.117 INFO:teuthology.nuke:Not nuking smithi165.front.sepia.ceph.com because description doesn't match