2021-10-02T15:15:52.404 INFO:root:teuthology version: 1.1.0-f08b273e 2021-10-02T15:15:52.528 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging 2021-10-02T15:15:52.529 INFO:teuthology.lock.ops:Updating [ubuntu@smithi098.front.sepia.ceph.com]: reset os type and version on server 2021-10-02T15:15:52.530 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2021-10-02T15:15:52.565 INFO:teuthology.lock.ops:Node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging is complete 2021-10-02T15:15:52.566 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging 2021-10-02T15:15:52.566 INFO:teuthology.lock.ops:Updating [ubuntu@smithi131.front.sepia.ceph.com]: reset os type and version on server 2021-10-02T15:15:52.566 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2021-10-02T15:15:52.585 INFO:teuthology.lock.ops:Node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging is complete 2021-10-02T15:15:52.798 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.4 2021-10-02T15:15:52.851 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of rhel 8.4 2021-10-02T15:15:53.155 INFO:teuthology.orchestra.console:Power off smithi098 2021-10-02T15:15:53.207 INFO:teuthology.orchestra.console:Power off smithi131 2021-10-02T15:16:01.577 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2021-10-02T15:16:01.678 INFO:teuthology.orchestra.console:Power on smithi131 2021-10-02T15:16:05.658 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2021-10-02T15:16:05.761 INFO:teuthology.orchestra.console:Power on smithi098 2021-10-02T15:16:10.023 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2021-10-02T15:16:10.053 INFO:teuthology.orchestra.console:Power on for smithi131 completed 2021-10-02T15:16:10.128 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2021-10-02T15:16:10.154 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2021-10-02T15:20:09.785 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-02T15:20:30.435 INFO:teuthology.provision.fog.smithi131:Node is ready 2021-10-02T15:20:30.454 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2021-10-02T15:20:30.510 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2021-10-02T15:20:30.852 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2021-10-02T15:20:57.620 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-02T15:20:57.845 INFO:teuthology.provision.fog.smithi098:Node is ready 2021-10-02T15:20:57.860 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2021-10-02T15:20:57.916 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2021-10-02T15:20:58.230 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2021-10-02T15:20:58.425 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2021-10-02T15:20:58.426 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-02T15:20:58.446 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2021-10-02T15:20:58.447 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-02T15:20:58.465 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2021-10-02T15:20:58.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2021-10-02T15:20:58.690 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2021-10-02T15:20:58.744 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2021-10-02T15:20:58.744 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.4 (Ootpa)" 2021-10-02T15:20:58.744 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2021-10-02T15:20:58.745 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2021-10-02T15:20:58.745 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.4" 2021-10-02T15:20:58.746 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2021-10-02T15:20:58.746 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-10-02T15:20:58.746 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2021-10-02T15:20:58.746 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-10-02T15:20:58.746 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2021-10-02T15:20:58.747 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-10-02T15:20:58.747 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-10-02T15:20:58.747 INFO:teuthology.orchestra.run.smithi098.stdout: 2021-10-02T15:20:58.747 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-10-02T15:20:58.748 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-10-02T15:20:58.748 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-10-02T15:20:58.748 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-10-02T15:20:58.749 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2021-10-02T15:20:58.768 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2021-10-02T15:20:58.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2021-10-02T15:20:59.007 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2021-10-02T15:20:59.063 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux" 2021-10-02T15:20:59.063 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.4 (Ootpa)" 2021-10-02T15:20:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel" 2021-10-02T15:20:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora" 2021-10-02T15:20:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.4" 2021-10-02T15:20:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2021-10-02T15:20:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-10-02T15:20:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2021-10-02T15:20:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-10-02T15:20:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/" 2021-10-02T15:20:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-10-02T15:20:59.066 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-10-02T15:20:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2021-10-02T15:20:59.066 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-10-02T15:20:59.066 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-10-02T15:20:59.066 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-10-02T15:20:59.067 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-10-02T15:20:59.067 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2021-10-02T15:20:59.194 INFO:teuthology.dispatcher.supervisor:Running job 6417379 2021-10-02T15:20:59.195 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-10-02_13:01:47-rados-wip-yuri-testing-master-10.1.21-distro-basic-smithi/6417379 --name yuriw-2021-10-02_13:01:47-rados-wip-yuri-testing-master-10.1.21-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} -- /home/teuthworker/archive/yuriw-2021-10-02_13:01:47-rados-wip-yuri-testing-master-10.1.21-distro-basic-smithi/6417379/orig.config.yaml 2021-10-02T15:20:59.199 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-10-02_13:01:47-rados-wip-yuri-testing-master-10.1.21-distro-basic-smithi/6417379 2021-10-02T15:20:59.199 INFO:teuthology.dispatcher.supervisor:Job PID: 22512 2021-10-02T15:20:59.200 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-10-03T03:21:52.191 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-10-03T03:21:52.381 INFO:teuthology.kill:Killing Pids: {22512} 2021-10-03T03:21:53.569 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-10-03T03:21:53.570 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-10-03T03:21:53.570 INFO:teuthology.misc:Compressing logs... 2021-10-03T03:21:53.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2021-10-03T03:21:53.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2021-10-03T03:21:54.086 INFO:teuthology.misc:Compressing logs... 2021-10-03T03:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-10-03T03:21:55.232 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-10-03T03:21:55.874 INFO:teuthology.misc:Compressing logs... 2021-10-03T03:22:48.634 INFO:teuthology.kill:No teuthology processes running 2021-10-03T03:22:49.823 INFO:teuthology.kill:Nuking machines: ['smithi098', 'smithi131'] 2021-10-03T03:22:50.824 INFO:teuthology.kill:2021-10-03 03:22:50,824.824 INFO:teuthology.nuke:targets: 2021-10-03T03:22:50.825 INFO:teuthology.kill: smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA2+sYMUoIQ2UymyyE9VC2HOTZ6MLpmm+DZXXQ7SWGRKZRqQpLWyZFudkJFvQZcbEXSqQqtmGmre+aU8U3oy/KFIw+6rbgSMgEPajRhgQ/0+hVv843DtiQ5bqMg1gASypBZ4rzJ/bNdq5u9iJapP66tp+BPQSpz6EoWXKEWL/ZFod6VLMn+hssydB1J/798fgCwxwWJxhmLL6QwosT/R9pbTPG1CWirMS32Wt4kiMf2MQv3uKWMlmoHNU17CGz2YqkMEYIaHXIGSsDqhSOrbkP8lsGMPjBGCW33zrqnAg9obproiPohgm7z6gfZH11v+OdSH3QgZ0TCb+tTFYxowdtYy7nMubHGKoutr/dVU/edsQkWrGN+Os91VLvovQgGVqMKP0mBKU1MvGjblHZoeyXcpsXVirr3reB71LBa9i4YRfFcGbTx72/8eO1C2M+UvFbG9AKg2bFQ6bXpIAqBew76moAKp44nAiE04YLgyFXhV9mXPkBzdizXo/L3Q84tOM= 2021-10-03T03:22:50.825 INFO:teuthology.kill: smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEql/MRH6LYd9U5vv8h03JQ9kkMZUpoDwQ4Y6JBvFbSkm0avBEFOXjCb68Sj9StFYVs3xCQ7FOWVeNAlhkiYUVZryAhftQUv+8hvKHQmy5Iqk/uSWUykj9BfM72dMQrnD8SGsYTHIVf49r/cnQ3wYFF2U7llcy0yoAbkQr0mldCetQ4q785C8Ixet3lion4UfUUjg95Wei4Qr0QLuf38Qs9QLi3kH2Bm61cRdzHF0yGUrtbqNNBN9B1HMoI9E5L0Cb1nzGlzwfUdSRZI5dUeGjKi3KixutZpc/2CPv20L7Bl9Ym7+Uwq8pm1R4CZXjPkpFtzWxAaJnALmgw5ezPg92DHnNySWTfHkRoUvCjwcxlxDXOifiqY97AlY4o/o5WPaCsIXBSrit1w/E1nVafDfUN8yfelDofhO005AScyc0/qhkhQWcZ97jWlk1cuD8zCpdI8dqu8cWmcczpqKOr3uttNGPnJK5P3nBJI6VZn8XCUZX2tfsS9oajyfVac4+fvc= 2021-10-03T03:22:50.850 INFO:teuthology.kill:2021-10-03 03:22:50,850.850 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-03T03:22:50.853 INFO:teuthology.kill:2021-10-03 03:22:50,853.853 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-03T03:22:50.920 INFO:teuthology.kill:2021-10-03 03:22:50,919.919 INFO:teuthology.orchestra.console:Power off smithi098 2021-10-03T03:22:50.934 INFO:teuthology.kill:2021-10-03 03:22:50,934.934 INFO:teuthology.orchestra.console:Power off smithi131 2021-10-03T03:22:59.289 INFO:teuthology.kill:2021-10-03 03:22:59,289.289 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2021-10-03T03:22:59.434 INFO:teuthology.kill:2021-10-03 03:22:59,433.433 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2021-10-03T03:23:03.407 INFO:teuthology.kill:2021-10-03 03:23:03,407.407 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2021-10-03T03:23:03.563 INFO:teuthology.kill:2021-10-03 03:23:03,563.563 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2021-10-03T03:25:03.868 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15