2021-09-18T21:16:41.904 INFO:root:teuthology version: 1.1.0-4e1f59de 2021-09-18T21:16:42.016 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi013.front.sepia.ceph.com' reimaging 2021-09-18T21:16:42.018 INFO:teuthology.lock.ops:Updating [ubuntu@smithi013.front.sepia.ceph.com]: reset os type and version on server 2021-09-18T21:16:42.018 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server 2021-09-18T21:16:42.038 INFO:teuthology.lock.ops:Node 'ubuntu@smithi013.front.sepia.ceph.com' reimaging is complete 2021-09-18T21:16:42.039 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging 2021-09-18T21:16:42.039 INFO:teuthology.lock.ops:Updating [ubuntu@smithi196.front.sepia.ceph.com]: reset os type and version on server 2021-09-18T21:16:42.039 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2021-09-18T21:16:42.058 INFO:teuthology.lock.ops:Node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging is complete 2021-09-18T21:16:42.259 INFO:teuthology.provision.fog.smithi013:Scheduling deploy of rhel 8.4 2021-09-18T21:16:42.271 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.4 2021-09-18T21:16:42.544 INFO:teuthology.orchestra.console:Power off smithi013 2021-09-18T21:16:42.560 INFO:teuthology.orchestra.console:Power off smithi196 2021-09-18T21:16:42.690 INFO:teuthology.orchestra.console:Power off for smithi013 completed 2021-09-18T21:16:42.791 INFO:teuthology.orchestra.console:Power on smithi013 2021-09-18T21:16:50.928 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2021-09-18T21:16:51.030 INFO:teuthology.orchestra.console:Power on smithi196 2021-09-18T21:16:51.161 INFO:teuthology.orchestra.console:Power on for smithi013 completed 2021-09-18T21:16:51.262 INFO:teuthology.provision.fog.smithi013:Waiting for deploy to finish 2021-09-18T21:16:59.400 INFO:teuthology.orchestra.console:Power on for smithi196 completed 2021-09-18T21:16:59.501 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2021-09-18T21:20:58.673 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-18T21:20:58.891 INFO:teuthology.provision.fog.smithi013:Node is ready 2021-09-18T21:20:58.907 INFO:teuthology.orchestra.run.smithi013.stdout:smithi013.front.sepia.ceph.com 2021-09-18T21:20:58.963 INFO:teuthology.orchestra.run.smithi013.stdout:172.21.15.13 smithi013.front.sepia.ceph.com smithi013 2021-09-18T21:20:59.304 INFO:teuthology.provision.fog.smithi013:Deploy complete! 2021-09-18T21:21:40.110 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-18T21:21:40.359 INFO:teuthology.provision.fog.smithi196:Node is ready 2021-09-18T21:21:40.374 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2021-09-18T21:21:40.429 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2021-09-18T21:21:40.750 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2021-09-18T21:21:40.892 INFO:teuthology.lock.ops:Checking smithi013.front.sepia.ceph.com 2021-09-18T21:21:40.893 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-18T21:21:40.910 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2021-09-18T21:21:40.910 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-18T21:21:40.926 INFO:teuthology.lock.ops:Updating [smithi013.front.sepia.ceph.com]: set os type and version on server 2021-09-18T21:21:40.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi013.front.sepia.ceph.com' 2021-09-18T21:21:41.170 INFO:teuthology.orchestra.run.smithi013.stdout:x86_64 2021-09-18T21:21:41.226 INFO:teuthology.orchestra.run.smithi013.stdout:NAME="Red Hat Enterprise Linux" 2021-09-18T21:21:41.227 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION="8.4 (Ootpa)" 2021-09-18T21:21:41.227 INFO:teuthology.orchestra.run.smithi013.stdout:ID="rhel" 2021-09-18T21:21:41.227 INFO:teuthology.orchestra.run.smithi013.stdout:ID_LIKE="fedora" 2021-09-18T21:21:41.227 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_ID="8.4" 2021-09-18T21:21:41.228 INFO:teuthology.orchestra.run.smithi013.stdout:PLATFORM_ID="platform:el8" 2021-09-18T21:21:41.228 INFO:teuthology.orchestra.run.smithi013.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-09-18T21:21:41.228 INFO:teuthology.orchestra.run.smithi013.stdout:ANSI_COLOR="0;31" 2021-09-18T21:21:41.228 INFO:teuthology.orchestra.run.smithi013.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-09-18T21:21:41.229 INFO:teuthology.orchestra.run.smithi013.stdout:HOME_URL="https://www.redhat.com/" 2021-09-18T21:21:41.229 INFO:teuthology.orchestra.run.smithi013.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-09-18T21:21:41.229 INFO:teuthology.orchestra.run.smithi013.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-09-18T21:21:41.229 INFO:teuthology.orchestra.run.smithi013.stdout: 2021-09-18T21:21:41.230 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-09-18T21:21:41.230 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-09-18T21:21:41.230 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-09-18T21:21:41.230 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-09-18T21:21:41.232 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server 2021-09-18T21:21:41.248 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2021-09-18T21:21:41.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2021-09-18T21:21:41.466 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2021-09-18T21:21:41.521 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux" 2021-09-18T21:21:41.521 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.4 (Ootpa)" 2021-09-18T21:21:41.521 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel" 2021-09-18T21:21:41.521 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora" 2021-09-18T21:21:41.522 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.4" 2021-09-18T21:21:41.522 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2021-09-18T21:21:41.522 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-09-18T21:21:41.522 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2021-09-18T21:21:41.523 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-09-18T21:21:41.523 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/" 2021-09-18T21:21:41.523 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-09-18T21:21:41.523 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-09-18T21:21:41.524 INFO:teuthology.orchestra.run.smithi196.stdout: 2021-09-18T21:21:41.524 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-09-18T21:21:41.524 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-09-18T21:21:41.524 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-09-18T21:21:41.524 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-09-18T21:21:41.525 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2021-09-18T21:21:41.607 INFO:teuthology.dispatcher.supervisor:Running job 6396469 2021-09-18T21:21:41.608 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_4e1f59de82924f116bd6b91664f90ef632c60a3f/virtualenv/bin/teuthology -v --owner scheduled_ozeneva@teuthology --archive /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396469 --name ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} -- /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396469/orig.config.yaml 2021-09-18T21:21:41.611 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396469 2021-09-18T21:21:41.612 INFO:teuthology.dispatcher.supervisor:Job PID: 6557 2021-09-18T21:21:41.612 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-09-19T09:22:33.508 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-09-19T09:22:33.714 INFO:teuthology.kill:Killing Pids: {6557} 2021-09-19T09:22:34.959 INFO:teuthology.task.internal:roles: ubuntu@smithi013.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-09-19T09:22:34.960 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-09-19T09:22:34.960 INFO:teuthology.misc:Compressing logs... 2021-09-19T09:22:34.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi013.front.sepia.ceph.com' 2021-09-19T09:22:35.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2021-09-19T09:22:35.690 INFO:teuthology.misc:Compressing logs... 2021-09-19T09:22:36.826 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-19T09:22:36.906 INFO:teuthology.orchestra.run.smithi013.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-19T09:25:08.526 INFO:teuthology.misc:Compressing logs... 2021-09-19T09:25:12.947 INFO:teuthology.kill:No teuthology processes running 2021-09-19T09:25:14.084 INFO:teuthology.kill:Nuking machines: ['smithi013', 'smithi196'] 2021-09-19T09:25:15.112 INFO:teuthology.kill:2021-09-19 09:25:15,112.112 INFO:teuthology.nuke:targets: 2021-09-19T09:25:15.113 INFO:teuthology.kill: smithi013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+VX6tG8/g+EuWECGlzqG2Vgi85jo5cHMCLBSr412CYy2BCkrGL9TfAD1FBvDbAK8pimI5Y0dcmU/1JlPZdisytTI67/ElLFWcTeoISk56DQgCnFCIV8wxnOCNGVNSaGe34qZgfWDPuAyLDZ//sLptqMCsuRHAqe7R7TBUQszWmUN0HxXbzFQcWcpMuuF22hYLm2n8uNTcL6eTbSAf6MHylyfaPIcQ4XSeQjfr+PvxftXPU7L8XiILNk+bvAt3KJyj1ybpinhLMrfu3SNR2n+1WPtdyCYwxhqpKV79GWYdq6Z3cUG3schyvEojfdWx9nVgS6TcKqPWZpwo5bfiVrP+YA38bVUYNxvT1s/2eNDOHUSpXAVah2U7ANyR6U11kBGkXepSuICz1XlMWGNlyGZc9ncLYH0ig+zMniy/X+H706z/+GaXAj5gV6/Kx6Z44/cOubY0uNVpkqx/5+4qqdx6prz61m9gVCiuxvPVpFA0sjdhblWTMN8TMitDuAJaSTU= 2021-09-19T09:25:15.113 INFO:teuthology.kill: smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA0wceSSJ+9UadCajcYG3Z3nVrxAc9xQsYMNhOBtB2oeMvBtC6uNdGKG67Xn7gW5ghcQ5IDj+D4uhzyjv1S3z1hzUd2+3z3To9ZWzbrbpzViguR9g/ZiHcXBbdL9dqDW7gnD4ddXtgdv8OkWCu+HBppitVSpP+ExymGJdMqxm1ps9SRvXe3C3Hqku8El6idvgZYL6zgvjqXJjIQqN/10U8mP9JaA0pgvh0KTS37I2kEuTyGIaOlDkPwl2InAPB9WBv/d05RR4oT8nWDpE9mSr3R94cx/NvOh9a/jihcSJrOnOr3J4jkaa8wlE02OjsH0PYtiUF6vRACtZCWdJO025Kub8a94A8B3tfSf6Accu6ZR2g+2EHxhlc12CtsUUdi39WiHFa/nOK6iDWZi4QRDZD5AcGGb03UimQitq/YKTXrnqyRytxJB3JjVtzjb8eEVtkomtBi/CvOypTCmjJiXQRewKqu4az90Gq0spiwkVIC0i/y8Js/YxS1lJGUCB0LHk= 2021-09-19T09:25:15.135 INFO:teuthology.kill:2021-09-19 09:25:15,135.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-19T09:25:15.138 INFO:teuthology.kill:2021-09-19 09:25:15,138.138 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-19T09:25:15.202 INFO:teuthology.kill:2021-09-19 09:25:15,202.202 INFO:teuthology.orchestra.console:Power off smithi196 2021-09-19T09:25:15.240 INFO:teuthology.kill:2021-09-19 09:25:15,239.239 INFO:teuthology.orchestra.console:Power off smithi013 2021-09-19T09:25:23.613 INFO:teuthology.kill:2021-09-19 09:25:23,613.613 INFO:teuthology.orchestra.console:Power off for smithi013 completed 2021-09-19T09:25:23.761 INFO:teuthology.kill:2021-09-19 09:25:23,760.760 INFO:teuthology.lock.ops:unlocked smithi013.front.sepia.ceph.com 2021-09-19T09:25:27.683 INFO:teuthology.kill:2021-09-19 09:25:27,682.682 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2021-09-19T09:25:27.824 INFO:teuthology.kill:2021-09-19 09:25:27,824.824 INFO:teuthology.lock.ops:unlocked smithi196.front.sepia.ceph.com 2021-09-19T09:27:28.127 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-09-19T09:27:28.230 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-09-19T09:27:28.230 INFO:teuthology.nuke:Checking targets against current locks 2021-09-19T09:27:28.317 INFO:teuthology.nuke:Not nuking smithi196.front.sepia.ceph.com because description doesn't match 2021-09-19T09:27:28.318 INFO:teuthology.nuke:Not nuking smithi013.front.sepia.ceph.com because description doesn't match