2021-10-31T23:24:15.259 INFO:root:teuthology version: 1.1.0-c56135d1 2021-10-31T23:24:15.381 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging 2021-10-31T23:24:15.382 INFO:teuthology.lock.ops:Updating [ubuntu@smithi071.front.sepia.ceph.com]: reset os type and version on server 2021-10-31T23:24:15.382 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2021-10-31T23:24:15.402 INFO:teuthology.lock.ops:Node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging is complete 2021-10-31T23:24:15.403 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging 2021-10-31T23:24:15.404 INFO:teuthology.lock.ops:Updating [ubuntu@smithi079.front.sepia.ceph.com]: reset os type and version on server 2021-10-31T23:24:15.405 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2021-10-31T23:24:15.438 INFO:teuthology.lock.ops:Node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging is complete 2021-10-31T23:24:15.666 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 8.3 2021-10-31T23:24:15.670 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.3 2021-10-31T23:24:16.026 INFO:teuthology.orchestra.console:Power off smithi071 2021-10-31T23:24:16.040 INFO:teuthology.orchestra.console:Power off smithi079 2021-10-31T23:24:24.391 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2021-10-31T23:24:24.493 INFO:teuthology.orchestra.console:Power on smithi071 2021-10-31T23:24:28.515 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2021-10-31T23:24:28.616 INFO:teuthology.orchestra.console:Power on smithi079 2021-10-31T23:24:32.858 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2021-10-31T23:24:32.870 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2021-10-31T23:24:32.960 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2021-10-31T23:24:32.971 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2021-10-31T23:29:26.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-31T23:29:26.317 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-31T23:29:26.530 INFO:teuthology.provision.fog.smithi071:Node is ready 2021-10-31T23:29:26.545 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2021-10-31T23:29:26.599 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2021-10-31T23:29:26.641 INFO:teuthology.provision.fog.smithi079:Node is ready 2021-10-31T23:29:26.657 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2021-10-31T23:29:26.712 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2021-10-31T23:29:26.940 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2021-10-31T23:29:27.043 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2021-10-31T23:29:27.193 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2021-10-31T23:29:27.194 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-31T23:29:27.213 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2021-10-31T23:29:27.214 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-31T23:29:27.249 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2021-10-31T23:29:27.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2021-10-31T23:29:27.451 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2021-10-31T23:29:27.505 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Linux" 2021-10-31T23:29:27.505 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2021-10-31T23:29:27.505 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2021-10-31T23:29:27.505 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2021-10-31T23:29:27.506 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2021-10-31T23:29:27.506 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2021-10-31T23:29:27.506 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-31T23:29:27.506 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2021-10-31T23:29:27.507 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-31T23:29:27.507 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2021-10-31T23:29:27.507 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-31T23:29:27.507 INFO:teuthology.orchestra.run.smithi071.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-31T23:29:27.508 INFO:teuthology.orchestra.run.smithi071.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-31T23:29:27.509 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2021-10-31T23:29:27.526 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2021-10-31T23:29:27.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2021-10-31T23:29:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2021-10-31T23:29:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Linux" 2021-10-31T23:29:27.839 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8" 2021-10-31T23:29:27.840 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2021-10-31T23:29:27.840 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2021-10-31T23:29:27.840 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2021-10-31T23:29:27.840 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2021-10-31T23:29:27.841 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-31T23:29:27.841 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2021-10-31T23:29:27.841 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-31T23:29:27.841 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2021-10-31T23:29:27.842 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-31T23:29:27.842 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-31T23:29:27.842 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-31T23:29:27.843 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2021-10-31T23:29:27.943 INFO:teuthology.dispatcher.supervisor:Running job 6471310 2021-10-31T23:29:27.944 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_ozeneva@teuthology --archive /home/teuthworker/archive/ozeneva-2021-10-31_23:22:37-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6471310 --name ozeneva-2021-10-31_23:22:37-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/archive/ozeneva-2021-10-31_23:22:37-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6471310/orig.config.yaml 2021-10-31T23:29:27.947 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ozeneva-2021-10-31_23:22:37-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6471310 2021-10-31T23:29:27.948 INFO:teuthology.dispatcher.supervisor:Job PID: 4963 2021-10-31T23:29:27.948 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-01T11:30:21.477 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-01T11:30:21.642 INFO:teuthology.kill:Killing Pids: {4963} 2021-11-01T11:30:22.708 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-11-01T11:30:22.709 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-11-01T11:30:22.709 INFO:teuthology.misc:Compressing logs... 2021-11-01T11:30:22.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2021-11-01T11:30:22.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2021-11-01T11:30:23.366 INFO:teuthology.misc:Compressing logs... 2021-11-01T11:30:24.473 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-11-01T11:30:24.491 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-11-01T11:30:50.650 INFO:teuthology.misc:Compressing logs... 2021-11-01T11:32:26.819 INFO:teuthology.kill:No teuthology processes running 2021-11-01T11:32:27.839 INFO:teuthology.kill:Nuking machines: ['smithi071', 'smithi079'] 2021-11-01T11:32:28.687 INFO:teuthology.kill:2021-11-01 11:32:28,687.687 INFO:teuthology.nuke:targets: 2021-11-01T11:32:28.688 INFO:teuthology.kill: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvpWgI6qKBjG/ivKUVpDooIIYw8vlCywDObbFwstxmYvK+FAio23hEeYqsuaW+3stkWmMXXzUq+gKf4hqd4PofCWuXa82Y6XZhH+0zm67c7mtihSO3qAik8Wz5bh91Ndg7AeHicI59X+64dOXBI7s4/gu0WvLAZvvIb88t5snkPI2pAc9YOLUZal9PErI5weNzdWsvgUODPZ3QKpdoMREqlUNuI/Ze8EwQ+0GIGyceySsr9nlfXlFQ9woiaECaVBafwbsoJSsMmz986LDxFIsIovZAqCuyhCXvGZH9zna4/2aPOfInJbkpxGB3PyOPpUeVs2yMtFWM/xgcBJq0qXr4Qw2RMVu+QN6UMmxwbELGKZRQwY17B9IBmP/1oZHvIsRXslZrvqeHWdXDD6gdfaB7uWJBktKqe4KQySATsZHHwIYwWwPjB+S5z8l/Z5RGX3kp3WGOC/UAUprRGh8XTBuEb7/vgc7sTiznHl07wp0miMTeErIlq06vDXOVgG0Ce9c= 2021-11-01T11:32:28.688 INFO:teuthology.kill: smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjJTU+Z68ls/Gp3GbD+AUu0yvY7oHnopNdRp2H5c60svr2YI2dBHt1+fGiu6iJyX7d/s5fY/3/GT3mU48gUSE8oI7Z3VcjV3++jtcUd4VfQVCMTR5ryt9QKSCIdCHIG1KE5vJA/r16lfmiDrSQmSGGhgQgQu7YOwPllFASVeh5N26CpPZnloaVeEOupqtg0m2i2xqX0GED8qM4ufB8HPBFaZZiSOLBbTnr2YNrqJuM27n8SvMHUE/OUJfW9IZ9TLRO8xDTfK7ZfB7xlDrsLpxJ+dKKUCUH1LSysdaS9RYCn3bUWqhCHXvBIFzzue/17h+GH7iS1mCS2sWQ6IIRR+R0NSUlnYsCn/QiKCK9VyD3yPIi+G70zcREr0F6lE2zMIbECOEgzF6/o79RMtcOBx16vubQJjP1Wdim6/qxRPQUXvSIlcVnV8U6RJCSn+SbQacqV2Aqynd2IHm6gtVBvFj0lgeaTbCMlkTiCRONum7oXYZH3YhlrAg0MaEHBSNW6F8= 2021-11-01T11:32:28.713 INFO:teuthology.kill:2021-11-01 11:32:28,712.712 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-01T11:32:28.716 INFO:teuthology.kill:2021-11-01 11:32:28,715.715 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-01T11:32:28.791 INFO:teuthology.kill:2021-11-01 11:32:28,790.790 INFO:teuthology.orchestra.console:Power off smithi071 2021-11-01T11:32:28.803 INFO:teuthology.kill:2021-11-01 11:32:28,803.803 INFO:teuthology.orchestra.console:Power off smithi079 2021-11-01T11:32:37.165 INFO:teuthology.kill:2021-11-01 11:32:37,165.165 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2021-11-01T11:32:37.312 INFO:teuthology.kill:2021-11-01 11:32:37,311.311 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2021-11-01T11:32:41.272 INFO:teuthology.kill:2021-11-01 11:32:41,272.272 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2021-11-01T11:32:41.416 INFO:teuthology.kill:2021-11-01 11:32:41,416.416 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2021-11-01T11:34:41.695 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15