2021-12-16T13:22:54.402 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-16T13:22:54.536 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi035.front.sepia.ceph.com' reimaging 2021-12-16T13:22:54.537 INFO:teuthology.lock.ops:Updating [ubuntu@smithi035.front.sepia.ceph.com]: reset os type and version on server 2021-12-16T13:22:54.538 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2021-12-16T13:22:54.559 INFO:teuthology.lock.ops:Node 'ubuntu@smithi035.front.sepia.ceph.com' reimaging is complete 2021-12-16T13:22:54.559 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging 2021-12-16T13:22:54.559 INFO:teuthology.lock.ops:Updating [ubuntu@smithi062.front.sepia.ceph.com]: reset os type and version on server 2021-12-16T13:22:54.559 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2021-12-16T13:22:54.579 INFO:teuthology.lock.ops:Node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging is complete 2021-12-16T13:22:54.811 INFO:teuthology.provision.fog.smithi035:Scheduling deploy of centos 8.3 2021-12-16T13:22:54.814 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.3 2021-12-16T13:22:55.240 INFO:teuthology.orchestra.console:Power off smithi035 2021-12-16T13:22:55.303 INFO:teuthology.orchestra.console:Power off smithi062 2021-12-16T13:23:03.670 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2021-12-16T13:23:03.771 INFO:teuthology.orchestra.console:Power on smithi062 2021-12-16T13:23:07.720 INFO:teuthology.orchestra.console:Power off for smithi035 completed 2021-12-16T13:23:07.823 INFO:teuthology.orchestra.console:Power on smithi035 2021-12-16T13:23:12.137 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2021-12-16T13:23:12.238 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2021-12-16T13:23:16.190 INFO:teuthology.orchestra.console:Power on for smithi035 completed 2021-12-16T13:23:16.291 INFO:teuthology.provision.fog.smithi035:Waiting for deploy to finish 2021-12-16T13:27:51.046 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-16T13:27:51.347 INFO:teuthology.provision.fog.smithi035:Node is ready 2021-12-16T13:27:51.404 INFO:teuthology.orchestra.run.smithi035.stdout:smithi035.front.sepia.ceph.com 2021-12-16T13:27:51.461 INFO:teuthology.orchestra.run.smithi035.stdout:172.21.15.35 smithi035.front.sepia.ceph.com smithi035 2021-12-16T13:27:51.801 INFO:teuthology.provision.fog.smithi035:Deploy complete! 2021-12-16T13:28:02.041 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-16T13:28:02.371 INFO:teuthology.provision.fog.smithi062:Node is ready 2021-12-16T13:28:02.387 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2021-12-16T13:28:02.443 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2021-12-16T13:28:02.776 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2021-12-16T13:28:02.931 INFO:teuthology.lock.ops:Checking smithi035.front.sepia.ceph.com 2021-12-16T13:28:02.933 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-16T13:28:02.955 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2021-12-16T13:28:02.955 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-16T13:28:02.974 INFO:teuthology.lock.ops:Updating [smithi035.front.sepia.ceph.com]: set os type and version on server 2021-12-16T13:28:02.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2021-12-16T13:28:03.251 INFO:teuthology.orchestra.run.smithi035.stdout:x86_64 2021-12-16T13:28:03.307 INFO:teuthology.orchestra.run.smithi035.stdout:NAME="CentOS Linux" 2021-12-16T13:28:03.308 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION="8" 2021-12-16T13:28:03.308 INFO:teuthology.orchestra.run.smithi035.stdout:ID="centos" 2021-12-16T13:28:03.308 INFO:teuthology.orchestra.run.smithi035.stdout:ID_LIKE="rhel fedora" 2021-12-16T13:28:03.308 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION_ID="8" 2021-12-16T13:28:03.309 INFO:teuthology.orchestra.run.smithi035.stdout:PLATFORM_ID="platform:el8" 2021-12-16T13:28:03.309 INFO:teuthology.orchestra.run.smithi035.stdout:PRETTY_NAME="CentOS Linux 8" 2021-12-16T13:28:03.309 INFO:teuthology.orchestra.run.smithi035.stdout:ANSI_COLOR="0;31" 2021-12-16T13:28:03.309 INFO:teuthology.orchestra.run.smithi035.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-12-16T13:28:03.310 INFO:teuthology.orchestra.run.smithi035.stdout:HOME_URL="https://centos.org/" 2021-12-16T13:28:03.310 INFO:teuthology.orchestra.run.smithi035.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-12-16T13:28:03.310 INFO:teuthology.orchestra.run.smithi035.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-12-16T13:28:03.310 INFO:teuthology.orchestra.run.smithi035.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-12-16T13:28:03.312 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2021-12-16T13:28:03.332 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2021-12-16T13:28:03.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2021-12-16T13:28:03.542 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2021-12-16T13:28:03.598 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Linux" 2021-12-16T13:28:03.599 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2021-12-16T13:28:03.599 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2021-12-16T13:28:03.599 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2021-12-16T13:28:03.600 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2021-12-16T13:28:03.600 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2021-12-16T13:28:03.600 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Linux 8" 2021-12-16T13:28:03.601 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2021-12-16T13:28:03.601 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-12-16T13:28:03.601 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2021-12-16T13:28:03.601 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-12-16T13:28:03.602 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-12-16T13:28:03.602 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-12-16T13:28:03.602 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2021-12-16T13:28:03.700 INFO:teuthology.dispatcher.supervisor:Running job 6566514 2021-12-16T13:28:03.701 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_rzarzynski@teuthology --archive /home/teuthworker/archive/rzarzynski-2021-12-16_13:13:36-rados-master-distro-basic-smithi/6566514 --name rzarzynski-2021-12-16_13:13:36-rados-master-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/rzarzynski-2021-12-16_13:13:36-rados-master-distro-basic-smithi/6566514/orig.config.yaml 2021-12-16T13:28:03.704 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rzarzynski-2021-12-16_13:13:36-rados-master-distro-basic-smithi/6566514 2021-12-16T13:28:03.705 INFO:teuthology.dispatcher.supervisor:Job PID: 27085 2021-12-16T13:28:03.705 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-17T01:28:55.627 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-17T01:28:55.782 INFO:teuthology.kill:Killing Pids: {27085} 2021-12-17T01:28:56.837 INFO:teuthology.task.internal:roles: ubuntu@smithi035.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-12-17T01:28:56.838 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-12-17T01:28:56.838 INFO:teuthology.misc:Compressing logs... 2021-12-17T01:28:56.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2021-12-17T01:28:57.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2021-12-17T01:28:57.489 INFO:teuthology.misc:Compressing logs... 2021-12-17T01:28:57.644 INFO:teuthology.misc:Compressing logs... 2021-12-17T01:28:59.032 INFO:teuthology.orchestra.run.smithi035.stderr:gzip: /var/log/ceph/ceph-client.0.39148.log: file size changed while zipping 2021-12-17T01:31:33.357 INFO:teuthology.kill:No teuthology processes running 2021-12-17T01:31:34.483 INFO:teuthology.kill:Nuking machines: ['smithi035', 'smithi062'] 2021-12-17T01:31:35.367 INFO:teuthology.kill:2021-12-17 01:31:35,366.366 INFO:teuthology.nuke:targets: 2021-12-17T01:31:35.368 INFO:teuthology.kill: smithi035.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9qrJ/y6mnzG/n9eWpBeaD4qwIXvRLKuqAqFmK2HJk+IC8nhSyvIYoTrqHij2TFV8OJu3cbSEJz+lHQBnpg3/nSvWMHGttBDe9YpsxSyxAHGKNdH4vXVew7xrHJFWe6YV5aThrLck4NVocuVXcKvDS88OkfZwYN/I6diRUZPFjuk1aQQAM2Wf5KniT69udoM7jdPNXtmFGHeoAOa4tfV4bWYISyF0DLYbpteq4JFruAjg32XpT5BRGTZB71IVP0Nut2utVZWAuyC7vSwnUHlZcZ9Z6hjuvXbE0tm87yDla5HfjUQhS6GEBedRGpA7tnWk5tlMwj7gPUyZrFWYuIi5ad+C2TaH7Zt0apkuF52ejvmBdUYTmy5bHEZ7ZZQZ0pO0TDONdHQ+cTAbpA5f7VMBDR2vWg+7t2zeROAt6TaHtZCZS14DTNzTymkpbreYCzzTK4rq0Cr5dbVJCSnY0UnDZ1RR6UriVhNkoM1CYdJVZEToKexQmp+wbcBpT0e1xppc= 2021-12-17T01:31:35.368 INFO:teuthology.kill: smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSp8qLfNWcNJ0xYByDl93GiegRZ1YTBYbEQ+dYexLyq6n8yXi1seArOlOt6oxllWBr4GpGkg1RsT3WXobfEosgw22Ibf/qtvPOzUJFI581WrTqhmjtY0kJ3ZyELQSNhNrKXHHtMlOXwN1vNtA8zM4SNBCzXRZ8rTNIVeuAYfs+WWTqayC4wn1aLIOWmgfG1D8CZiVgTUfEXCKdwkoovyhjMfJXlCYQ8mmaq0pBpG0kQOoDH3jrsiQNzbM60+AuNC9KU9OwHi0l4RnBEgO/lbmR0ZuzxuorlTH1WgOqPLS8hBbGFzsRumXAakN1jCrD9jgagbC+wsIk6tzIDgpg8jDauHD+zgDxD7iPD/zCThCmZCNqiqr1V9aJWSSP4g7V+lAX9e4N5xU/F9bByncx+3CkyGFc7TYBd9s9SYVcrpYkStnjEWowleCfpjyQslCmj+vS6aTEkkSsU7tnRNJm7uXUQJZUGvUf7iXWxMNOxah/0s9IAC51Xd5ijPZUl2Fpoa0= 2021-12-17T01:31:35.394 INFO:teuthology.kill:2021-12-17 01:31:35,394.394 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-17T01:31:35.397 INFO:teuthology.kill:2021-12-17 01:31:35,397.397 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-17T01:31:35.470 INFO:teuthology.kill:2021-12-17 01:31:35,470.470 INFO:teuthology.orchestra.console:Power off smithi035 2021-12-17T01:31:35.484 INFO:teuthology.kill:2021-12-17 01:31:35,484.484 INFO:teuthology.orchestra.console:Power off smithi062 2021-12-17T01:31:43.842 INFO:teuthology.kill:2021-12-17 01:31:43,842.842 INFO:teuthology.orchestra.console:Power off for smithi035 completed 2021-12-17T01:31:43.847 INFO:teuthology.kill:2021-12-17 01:31:43,847.847 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2021-12-17T01:31:44.003 INFO:teuthology.kill:2021-12-17 01:31:44,002.002 INFO:teuthology.lock.ops:unlocked: smithi035.front.sepia.ceph.com 2021-12-17T01:31:44.006 INFO:teuthology.kill:2021-12-17 01:31:44,006.006 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2021-12-17T01:33:44.301 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15