2021-10-20T20:21:18.685 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-20T20:21:18.813 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi120.front.sepia.ceph.com' reimaging 2021-10-20T20:21:18.814 INFO:teuthology.lock.ops:Updating [ubuntu@smithi120.front.sepia.ceph.com]: reset os type and version on server 2021-10-20T20:21:18.815 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2021-10-20T20:21:18.835 INFO:teuthology.lock.ops:Node 'ubuntu@smithi120.front.sepia.ceph.com' reimaging is complete 2021-10-20T20:21:18.835 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging 2021-10-20T20:21:18.835 INFO:teuthology.lock.ops:Updating [ubuntu@smithi173.front.sepia.ceph.com]: reset os type and version on server 2021-10-20T20:21:18.836 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-10-20T20:21:18.858 INFO:teuthology.lock.ops:Node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging is complete 2021-10-20T20:21:19.051 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.3 2021-10-20T20:21:19.085 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.3 2021-10-20T20:21:19.449 INFO:teuthology.orchestra.console:Power off smithi120 2021-10-20T20:21:19.515 INFO:teuthology.orchestra.console:Power off smithi173 2021-10-20T20:21:31.941 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2021-10-20T20:21:31.994 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-10-20T20:21:32.049 INFO:teuthology.orchestra.console:Power on smithi120 2021-10-20T20:21:32.095 INFO:teuthology.orchestra.console:Power on smithi173 2021-10-20T20:21:36.338 INFO:teuthology.orchestra.console:Power on for smithi120 completed 2021-10-20T20:21:36.439 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2021-10-20T20:21:40.472 INFO:teuthology.orchestra.console:Power on for smithi173 completed 2021-10-20T20:21:40.573 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2021-10-20T20:26:30.417 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-20T20:26:30.731 INFO:teuthology.provision.fog.smithi173:Node is ready 2021-10-20T20:26:30.748 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2021-10-20T20:26:30.804 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2021-10-20T20:26:31.137 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2021-10-20T20:26:41.314 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-20T20:26:41.622 INFO:teuthology.provision.fog.smithi120:Node is ready 2021-10-20T20:26:41.637 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2021-10-20T20:26:41.692 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2021-10-20T20:26:42.008 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2021-10-20T20:26:42.195 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2021-10-20T20:26:42.199 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-20T20:26:42.248 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2021-10-20T20:26:42.249 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-20T20:26:42.272 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2021-10-20T20:26:42.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2021-10-20T20:26:42.471 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2021-10-20T20:26:42.525 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Linux" 2021-10-20T20:26:42.526 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8" 2021-10-20T20:26:42.526 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2021-10-20T20:26:42.526 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2021-10-20T20:26:42.526 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8" 2021-10-20T20:26:42.527 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2021-10-20T20:26:42.527 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-20T20:26:42.527 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2021-10-20T20:26:42.528 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-20T20:26:42.528 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2021-10-20T20:26:42.528 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-20T20:26:42.528 INFO:teuthology.orchestra.run.smithi120.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-20T20:26:42.529 INFO:teuthology.orchestra.run.smithi120.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-20T20:26:42.530 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2021-10-20T20:26:42.556 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2021-10-20T20:26:42.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2021-10-20T20:26:42.824 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2021-10-20T20:26:42.880 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Linux" 2021-10-20T20:26:42.881 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2021-10-20T20:26:42.882 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2021-10-20T20:26:42.883 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2021-10-20T20:26:42.883 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2021-10-20T20:26:42.883 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2021-10-20T20:26:42.884 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-20T20:26:42.884 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2021-10-20T20:26:42.885 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-20T20:26:42.885 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2021-10-20T20:26:42.885 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-20T20:26:42.886 INFO:teuthology.orchestra.run.smithi173.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-20T20:26:42.886 INFO:teuthology.orchestra.run.smithi173.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-20T20:26:42.888 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-10-20T20:26:42.983 INFO:teuthology.dispatcher.supervisor:Running job 6453220 2021-10-20T20:26:42.984 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-10-20_19:32:10-rados-wip-sage-testing-2021-10-19-1841-distro-basic-smithi/6453220 --name sage-2021-10-20_19:32:10-rados-wip-sage-testing-2021-10-19-1841-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} -- /home/teuthworker/archive/sage-2021-10-20_19:32:10-rados-wip-sage-testing-2021-10-19-1841-distro-basic-smithi/6453220/orig.config.yaml 2021-10-20T20:26:42.989 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-10-20_19:32:10-rados-wip-sage-testing-2021-10-19-1841-distro-basic-smithi/6453220 2021-10-20T20:26:42.990 INFO:teuthology.dispatcher.supervisor:Job PID: 29646 2021-10-20T20:26:42.990 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-10-21T08:27:37.409 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-10-21T08:27:37.662 INFO:teuthology.kill:Killing Pids: {29646} 2021-10-21T08:27:38.940 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-10-21T08:27:38.941 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-10-21T08:27:38.941 INFO:teuthology.misc:Compressing logs... 2021-10-21T08:27:38.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2021-10-21T08:27:39.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2021-10-21T08:27:39.630 INFO:teuthology.misc:Compressing logs... 2021-10-21T08:27:40.599 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-10-21T08:27:40.890 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-10-21T08:27:45.464 INFO:teuthology.misc:Compressing logs... 2021-10-21T08:30:13.166 INFO:teuthology.kill:No teuthology processes running 2021-10-21T08:30:14.281 INFO:teuthology.kill:Nuking machines: ['smithi120', 'smithi173'] 2021-10-21T08:30:15.252 INFO:teuthology.kill:2021-10-21 08:30:15,251.251 INFO:teuthology.nuke:targets: 2021-10-21T08:30:15.252 INFO:teuthology.kill: smithi120.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+WmIFhTqpHIg0kLrpV3Z4YAc8q5EzHHRY8gS6dNOBwtStj3EejTqFz6Qr6HFobO6EWxxrn0qaPp0o8kJJG/8n4jC6utt4K8L5WcerGcCpW3CXuIJMvVg3rHTmWnA14SUq7i9FdOLCHP4GbbAG4vMmQ/nqDMUd7i75abvwYtz89iQUboOayrACPx7Fx9ZXkp9yWojajEhtBuKTWqTPNieAhJiT/HNECDhZnNYjIUYhoqvNY9g8ksgcxo/n78pYNoO+b3Ksm+yubslOi6YM19/TvjSTN/NxOt1ZEqniaJAIBZZIKIELCx84gjAVg2DuM1CVxZw8maEnufQf/+bQwj5naKfT1a9JeBsGCEpCshQxY0s0nJB8V6D2o/XytxR+u8oRK7/eTgUgS3KXJfJBPK0K8pHi/MsL7HcCkDvBK0fhZImJsYfZiUHoMUnUH+2kYOBSPv5P36oBo8jRCuJshXNYJY9nUt+mHjAbHrkBXyI+Ink1WNqWdUzUNzXIptVMsqE= 2021-10-21T08:30:15.253 INFO:teuthology.kill: smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHzJxIySVZzAsy69OVmP47wqF1daDFaOGRk4xMs8l0LsZEvjfTrHF4IbW+69J+k+lAydxcZlzsemVnR63GMHzmynHMzimjioD3g4Q4WP8Kw/+VEJY5K4QUWXsH7ZsUdHdZI5GPv6KCKk7i8P9MJafKBq3apVwz5SMFRrkgUjqSYkmjz7kOcZn9fiqbB2UePcQHTlp+fNeT6GQ7oZKDjIRVEeeX3Ywxh4XAewSftXBqgoPRHl5FlUg/zQ9SHuuvlZ+7KPjTE6WM+JbahlCm3OPghXoXfdZ+c6yA7zBuxfaPRoa9IXw8LaRdZR+kcYO3IasDL8SsWJq+VLtJqw2Y+NjEZWCfrxdIjmWDRpKJU73aDHoHJ0W52Xrt2Rj5bBZUlG5qmStVWnC9A2Cu663BJirGFeKdgtB+wpeX9V3kqlBWI3MN4DL46NM3QJsbih36Wuc+62bWztLE7MdAdi/Xy16n0NDN1sEc+del79yWbeRe+y4RhLzC/R4TQmc1UWJYYbk= 2021-10-21T08:30:15.276 INFO:teuthology.kill:2021-10-21 08:30:15,275.275 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-21T08:30:15.279 INFO:teuthology.kill:2021-10-21 08:30:15,279.279 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-21T08:30:15.344 INFO:teuthology.kill:2021-10-21 08:30:15,343.343 INFO:teuthology.orchestra.console:Power off smithi173 2021-10-21T08:30:15.356 INFO:teuthology.kill:2021-10-21 08:30:15,356.356 INFO:teuthology.orchestra.console:Power off smithi120 2021-10-21T08:30:23.718 INFO:teuthology.kill:2021-10-21 08:30:23,718.718 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-10-21T08:30:23.867 INFO:teuthology.kill:2021-10-21 08:30:23,867.867 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com 2021-10-21T08:30:27.835 INFO:teuthology.kill:2021-10-21 08:30:27,835.835 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2021-10-21T08:30:27.972 INFO:teuthology.kill:2021-10-21 08:30:27,972.972 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com 2021-10-21T08:32:28.245 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15