2021-12-01T18:31:18.112 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-01T18:31:18.232 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging 2021-12-01T18:31:18.233 INFO:teuthology.lock.ops:Updating [ubuntu@smithi067.front.sepia.ceph.com]: reset os type and version on server 2021-12-01T18:31:18.234 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2021-12-01T18:31:18.259 INFO:teuthology.lock.ops:Node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging is complete 2021-12-01T18:31:18.260 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging 2021-12-01T18:31:18.260 INFO:teuthology.lock.ops:Updating [ubuntu@smithi146.front.sepia.ceph.com]: reset os type and version on server 2021-12-01T18:31:18.260 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2021-12-01T18:31:18.280 INFO:teuthology.lock.ops:Node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging is complete 2021-12-01T18:31:18.476 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 8.3 2021-12-01T18:31:18.493 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.3 2021-12-01T18:31:18.829 INFO:teuthology.orchestra.console:Power off smithi067 2021-12-01T18:31:18.844 INFO:teuthology.orchestra.console:Power off smithi146 2021-12-01T18:31:18.974 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2021-12-01T18:31:19.075 INFO:teuthology.orchestra.console:Power on smithi067 2021-12-01T18:31:27.212 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2021-12-01T18:31:27.314 INFO:teuthology.orchestra.console:Power on smithi146 2021-12-01T18:31:27.439 INFO:teuthology.orchestra.console:Power on for smithi067 completed 2021-12-01T18:31:27.544 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2021-12-01T18:31:35.744 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2021-12-01T18:31:35.845 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2021-12-01T18:36:02.912 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-01T18:36:18.599 INFO:teuthology.provision.fog.smithi146:Node is ready 2021-12-01T18:36:18.617 INFO:teuthology.orchestra.run.smithi146.stdout:smithi133 2021-12-01T18:36:18.673 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2021-12-01T18:36:19.016 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2021-12-01T18:36:32.242 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-01T18:36:32.543 INFO:teuthology.provision.fog.smithi067:Node is ready 2021-12-01T18:36:32.559 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2021-12-01T18:36:32.615 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2021-12-01T18:36:32.936 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2021-12-01T18:36:33.111 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2021-12-01T18:36:33.112 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-01T18:36:33.133 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2021-12-01T18:36:33.133 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-01T18:36:33.152 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2021-12-01T18:36:33.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2021-12-01T18:36:33.357 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2021-12-01T18:36:33.413 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Linux" 2021-12-01T18:36:33.414 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8" 2021-12-01T18:36:33.414 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2021-12-01T18:36:33.414 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2021-12-01T18:36:33.415 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8" 2021-12-01T18:36:33.415 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2021-12-01T18:36:33.415 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Linux 8" 2021-12-01T18:36:33.415 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2021-12-01T18:36:33.416 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-12-01T18:36:33.416 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2021-12-01T18:36:33.416 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-12-01T18:36:33.416 INFO:teuthology.orchestra.run.smithi067.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-12-01T18:36:33.417 INFO:teuthology.orchestra.run.smithi067.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-12-01T18:36:33.419 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2021-12-01T18:36:33.440 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2021-12-01T18:36:33.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2021-12-01T18:36:33.713 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2021-12-01T18:36:33.768 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Linux" 2021-12-01T18:36:33.768 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2021-12-01T18:36:33.768 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2021-12-01T18:36:33.768 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2021-12-01T18:36:33.769 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2021-12-01T18:36:33.769 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2021-12-01T18:36:33.769 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Linux 8" 2021-12-01T18:36:33.769 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2021-12-01T18:36:33.770 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-12-01T18:36:33.770 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2021-12-01T18:36:33.770 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-12-01T18:36:33.771 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-12-01T18:36:33.771 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-12-01T18:36:33.772 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2021-12-01T18:36:33.869 INFO:teuthology.dispatcher.supervisor:Running job 6538575 2021-12-01T18:36:33.870 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_rzarzynski@teuthology --archive /home/teuthworker/archive/rzarzynski-2021-12-01_18:11:10-rados-master-distro-basic-smithi/6538575 --name rzarzynski-2021-12-01_18:11:10-rados-master-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/rzarzynski-2021-12-01_18:11:10-rados-master-distro-basic-smithi/6538575/orig.config.yaml 2021-12-01T18:36:33.874 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rzarzynski-2021-12-01_18:11:10-rados-master-distro-basic-smithi/6538575 2021-12-01T18:36:33.874 INFO:teuthology.dispatcher.supervisor:Job PID: 13946 2021-12-01T18:36:33.875 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-02T06:37:30.423 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-02T06:37:31.397 INFO:teuthology.kill:Killing Pids: {13946} 2021-12-02T06:37:32.885 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-12-02T06:37:32.892 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-12-02T06:37:32.904 INFO:teuthology.misc:Compressing logs... 2021-12-02T06:37:32.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2021-12-02T06:37:33.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2021-12-02T06:37:33.986 INFO:teuthology.misc:Compressing logs... 2021-12-02T06:37:34.166 INFO:teuthology.misc:Compressing logs... 2021-12-02T06:37:55.809 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/ceph-client.0.38938.log: file size changed while zipping 2021-12-02T06:40:10.813 INFO:teuthology.kill:No teuthology processes running 2021-12-02T06:40:12.113 INFO:teuthology.kill:Nuking machines: ['smithi067', 'smithi146'] 2021-12-02T06:40:13.102 INFO:teuthology.kill:2021-12-02 06:40:13,102.102 INFO:teuthology.nuke:targets: 2021-12-02T06:40:13.103 INFO:teuthology.kill: smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHnQr8k1oK7Zp7J1ts+SqpVrRtMm3sXsWVKYii1yR1BKflFrS4JnOsC0nyiGkKEpcthR/a8cRsbec2tIknZXkOn3V0OVPhO9NrDu3D/ASgUcdPo8ICk1MWU5AcL1IH9A16ZDxmZcxd2ogrPvfRij7opdv4yTNaKfVfkEwdrkFBpytqKirDNHbsB3qa9p1sF9YqTkwFbHEqMU4msT+bl8RfERfLaAPtT8r4YeNh+aTQYCh8O3KezZZpCBdmQcG+myxshxTq582OrOvlYi9kH8SozpjBSK/wwjIa///VxC5ag+71+4JY26LT+Nk1pCeJVlpblhTJnE061ghPNFc+kR49VJjGNrujDtA6UQkVeFPbetEktiGYpHkK4urFzMcerPwOdJBTIZtCOqaQcnGwXQcKbTU+xjBWXAyrN3rOKYQHH2qq/W7QeqREgoRuDtW1KGdpehytlm4Ue72aAh9Nt1dLRb9xu3WWuUNu518/o9DrX1UDiFLb/q/x5NX+AJDIRz8= 2021-12-02T06:40:13.104 INFO:teuthology.kill: smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ6LH+rsdYRK9PhrWSauoAjDsxw6CuWVWwlrro92TTOqWWvZ2zvnIJ7hAB56Omnxacwe2MkxwE+mi9qNI35GpAJO/U2lyewOGLPH5kfRTt/SL5ZoHVQbtLa9QljwUljEHPe7ZcnEnJr5P8EsIs/256RHaslF2AB06gRCb1RkeyHOCRpcpU+E26DV3CK5obo49qrq4UiCntz++I5eqgvAIHH5fub0bGVVW7jJR1qc8rJvWKmgBDruxBPbZtOI8bFrz4ByFhGNxY0PEMYLl88syfQ3Ea56MxreAsOaANGEAvN74L0UprMV9ZgX6QKTm1GyPbmlkrfN3I3/bfV3RsjnWB2EmTCVR43bzQJCovFwwza5+4R6pdJWRf2u5hNhMWcKjMWEg51SsmNlf7HAgq7bMK5jqyNtPGB0pMXK2K1X3ZmIENprzZ/B8LpYdlonuxOemJAGZTNBTS2sQBO1OVKvH+48I0rdo+cQCkmPjQph5i14A4Rmn4xuxvr/ga5Rovhy0= 2021-12-02T06:40:13.131 INFO:teuthology.kill:2021-12-02 06:40:13,131.131 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-02T06:40:13.135 INFO:teuthology.kill:2021-12-02 06:40:13,135.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-02T06:40:13.213 INFO:teuthology.kill:2021-12-02 06:40:13,212.212 INFO:teuthology.orchestra.console:Power off smithi067 2021-12-02T06:40:13.227 INFO:teuthology.kill:2021-12-02 06:40:13,226.226 INFO:teuthology.orchestra.console:Power off smithi146 2021-12-02T06:40:21.587 INFO:teuthology.kill:2021-12-02 06:40:21,587.587 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2021-12-02T06:40:21.734 INFO:teuthology.kill:2021-12-02 06:40:21,733.733 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2021-12-02T06:40:25.708 INFO:teuthology.kill:2021-12-02 06:40:25,707.707 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2021-12-02T06:40:25.857 INFO:teuthology.kill:2021-12-02 06:40:25,856.856 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2021-12-02T06:42:26.197 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15