2021-09-18T20:20:47.738 INFO:root:teuthology version: 1.1.0-4e1f59de 2021-09-18T20:20:47.858 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi045.front.sepia.ceph.com' reimaging 2021-09-18T20:20:47.860 INFO:teuthology.lock.ops:Updating [ubuntu@smithi045.front.sepia.ceph.com]: reset os type and version on server 2021-09-18T20:20:47.860 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2021-09-18T20:20:47.877 INFO:teuthology.lock.ops:Node 'ubuntu@smithi045.front.sepia.ceph.com' reimaging is complete 2021-09-18T20:20:47.878 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging 2021-09-18T20:20:47.878 INFO:teuthology.lock.ops:Updating [ubuntu@smithi105.front.sepia.ceph.com]: reset os type and version on server 2021-09-18T20:20:47.879 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2021-09-18T20:20:47.895 INFO:teuthology.lock.ops:Node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging is complete 2021-09-18T20:20:48.092 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.stream 2021-09-18T20:20:48.111 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2021-09-18T20:20:48.382 INFO:teuthology.orchestra.console:Power off smithi045 2021-09-18T20:20:48.399 INFO:teuthology.orchestra.console:Power off smithi105 2021-09-18T20:20:48.528 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2021-09-18T20:20:48.538 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2021-09-18T20:20:48.630 INFO:teuthology.orchestra.console:Power on smithi045 2021-09-18T20:20:48.639 INFO:teuthology.orchestra.console:Power on smithi105 2021-09-18T20:20:52.894 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2021-09-18T20:20:52.995 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2021-09-18T20:20:57.002 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2021-09-18T20:20:57.103 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2021-09-18T20:24:59.423 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-18T20:25:13.813 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-18T20:25:14.080 INFO:teuthology.provision.fog.smithi045:Node is ready 2021-09-18T20:25:14.097 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2021-09-18T20:25:14.155 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2021-09-18T20:25:14.513 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2021-09-18T20:25:19.731 INFO:teuthology.provision.fog.smithi105:Node is ready 2021-09-18T20:25:19.752 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2021-09-18T20:25:19.813 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2021-09-18T20:25:20.183 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2021-09-18T20:25:20.322 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2021-09-18T20:25:20.323 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-18T20:25:20.340 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2021-09-18T20:25:20.340 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-18T20:25:20.356 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2021-09-18T20:25:20.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2021-09-18T20:25:20.597 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2021-09-18T20:25:20.654 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2021-09-18T20:25:20.654 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2021-09-18T20:25:20.654 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2021-09-18T20:25:20.655 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2021-09-18T20:25:20.655 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2021-09-18T20:25:20.655 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2021-09-18T20:25:20.655 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2021-09-18T20:25:20.656 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2021-09-18T20:25:20.656 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-09-18T20:25:20.656 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2021-09-18T20:25:20.656 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-09-18T20:25:20.657 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-09-18T20:25:20.657 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-09-18T20:25:20.658 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2021-09-18T20:25:20.673 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2021-09-18T20:25:20.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2021-09-18T20:25:20.949 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2021-09-18T20:25:21.008 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2021-09-18T20:25:21.009 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2021-09-18T20:25:21.009 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2021-09-18T20:25:21.010 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2021-09-18T20:25:21.010 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2021-09-18T20:25:21.010 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2021-09-18T20:25:21.011 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2021-09-18T20:25:21.011 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2021-09-18T20:25:21.011 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-09-18T20:25:21.011 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2021-09-18T20:25:21.012 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-09-18T20:25:21.012 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-09-18T20:25:21.012 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-09-18T20:25:21.013 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2021-09-18T20:25:21.110 INFO:teuthology.dispatcher.supervisor:Running job 6396408 2021-09-18T20:25:21.110 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_4e1f59de82924f116bd6b91664f90ef632c60a3f/virtualenv/bin/teuthology -v --owner scheduled_ozeneva@teuthology --archive /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396408 --name ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache-pool-snaps} -- /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396408/orig.config.yaml 2021-09-18T20:25:21.114 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ozeneva-2021-09-18_18:19:17-rados-wip-omri-tracer-2-distro-basic-smithi/6396408 2021-09-18T20:25:21.115 INFO:teuthology.dispatcher.supervisor:Job PID: 28219 2021-09-18T20:25:21.115 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-09-19T08:26:11.759 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-09-19T08:26:12.023 INFO:teuthology.kill:Killing Pids: {28219} 2021-09-19T08:26:13.238 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-09-19T08:26:13.239 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-09-19T08:26:13.240 INFO:teuthology.misc:Compressing logs... 2021-09-19T08:26:13.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2021-09-19T08:26:13.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2021-09-19T08:26:13.909 INFO:teuthology.misc:Compressing logs... 2021-09-19T08:26:15.060 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-19T08:26:15.154 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-19T08:28:08.028 INFO:teuthology.misc:Compressing logs... 2021-09-19T08:28:10.297 INFO:teuthology.kill:No teuthology processes running 2021-09-19T08:28:11.380 INFO:teuthology.kill:Nuking machines: ['smithi045', 'smithi105'] 2021-09-19T08:28:12.373 INFO:teuthology.kill:2021-09-19 08:28:12,372.372 INFO:teuthology.nuke:targets: 2021-09-19T08:28:12.374 INFO:teuthology.kill: smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4tLm1DzemtUhJzCL5iS62GJMQUX1qi5R6seqZrm6s+nu6udfXVTe68dqP4Zh9gctpGZmY1aMmRDPdOCMuwXDws8sPahO4kgErOkqmF4ZPeoHhw/EIws5WjHb7a+u3lTIeciBgo7VVgp6c9/WjO85f7AKyvR7H0NKgO+Q4Wu6vENcrbXdMR02KbLbDRCvK4ZPPtLtLW/kEpbgV7ePg0n02EDN0Y9MR422WJpDjnWTjzWIK6yyRIs6FyKUkQeAYVcGJ2iFJQQfOjS6BkUQqKtNkcEpaaGAjQ20621RK6YiqChlxvtemckwnqNIcyr4rS55aEgQ/hBHGxTtKJihzE4cV4hTYNcwf0vX2i+QQEsnd9ocZ7kyrrbw/P+at2vO7DiAY9M/u31yTxFOgc+htAF3xDKs58oPLxI6k54IsRTkAxZBunSAmUoJHwy0Mh6IWtbPg05w9hLImWiiOrLZQfs/qcuL1su3QvurCFXaXZR5an00tQzvaYa8LT4DRExDuyO8= 2021-09-19T08:28:12.374 INFO:teuthology.kill: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdi6+cXtKMz/IF0nBeSljHlWJLfSerfvdrv6nSge12mXdTOy9+Ij2K/aOh2fRfH0xi/mGy/NQD/zVmRdgrSlKbxWaL+KMU5L4VZv7iLWWkuUfPPFrVuNRVbjf0TcCwoqNRk4z+y5R1jUlfTFuWMD46rXEwVcbPvU5h8jZqA27QlRBpY9fn5EaXe2uN7//Sy1RUbjzDsQaYPHzlceaU9GeqYkM1HFgCOHxxNZb2YajDLj1B8kwngi3B957G/PoH0Tvg14NbEJbtGy7Ee2P8LIyblN1aJkh3e+qJPlZdUMnVlA9Jb4jObpdRdhMQvbrlF4/bVTr8LXhpLgxqu/wmBqmqGktfXX3AHm0tfIRgsevePeJxBSBm5sJx2+nm3vsMEMzqUdrKCMoPX2ldkr3x1qpqP0LjuWsSYaNw09KQ+ueQGMZ+w2llK1aKRyWenJBMJLlCmKOZRBJ2uXYh9goV0DYyq1BQREZTjZxvOkYk8r/DcEUB+Gz7r4Srvnec6oujyU8= 2021-09-19T08:28:12.395 INFO:teuthology.kill:2021-09-19 08:28:12,395.395 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-19T08:28:12.398 INFO:teuthology.kill:2021-09-19 08:28:12,398.398 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-19T08:28:12.462 INFO:teuthology.kill:2021-09-19 08:28:12,461.461 INFO:teuthology.orchestra.console:Power off smithi045 2021-09-19T08:28:12.476 INFO:teuthology.kill:2021-09-19 08:28:12,476.476 INFO:teuthology.orchestra.console:Power off smithi105 2021-09-19T08:28:20.846 INFO:teuthology.kill:2021-09-19 08:28:20,846.846 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2021-09-19T08:28:20.992 INFO:teuthology.kill:2021-09-19 08:28:20,991.991 INFO:teuthology.lock.ops:unlocked smithi045.front.sepia.ceph.com 2021-09-19T08:28:24.964 INFO:teuthology.kill:2021-09-19 08:28:24,963.963 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2021-09-19T08:28:25.107 INFO:teuthology.kill:2021-09-19 08:28:25,107.107 INFO:teuthology.lock.ops:unlocked smithi105.front.sepia.ceph.com 2021-09-19T08:30:25.408 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-09-19T08:30:25.511 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-09-19T08:30:25.512 INFO:teuthology.nuke:Checking targets against current locks 2021-09-19T08:30:25.595 INFO:teuthology.nuke:Not nuking smithi105.front.sepia.ceph.com because description doesn't match 2021-09-19T08:30:25.596 INFO:teuthology.nuke:Not nuking smithi045.front.sepia.ceph.com because description doesn't match