Found 367 jobs Ignoring malparsed backtrace: ceph version 16.0.0-6771-g038750c7 (038750c78afd56c7becf744cf7dc4f8d115793d3) pacific (dev) , 1: /lib64/libpthread.so.0(+0x12dc0) [0x7f3c123cbdc0] , 2: gsignal() Ignoring malparsed backtrace: 2020-10-31T10:07:54.693 INFO:teuthology.orchestra.run.smithi159:> sudo lsb_release -is , 2020-10-31T10:07:54.740 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS , 2020-10-31T10:07:54.740 DEBUG:teuthology.misc:System to be installed: CentOS Ignoring malparsed backtrace: ceph version 16.0.0-6771-g038750c7 (038750c78afd56c7becf744cf7dc4f8d115793d3) pacific (dev) , 1: /lib64/libpthread.so.0(+0x12dc0) [0x7f3c123cbdc0] , 2: gsignal() Ignoring malparsed backtrace: 2020-10-31T10:07:54.693 INFO:teuthology.orchestra.run.smithi159:> sudo lsb_release -is , 2020-10-31T10:07:54.740 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS , 2020-10-31T10:07:54.740 DEBUG:teuthology.misc:System to be installed: CentOS Ignoring malparsed backtrace: ceph version 16.0.0-6771-g038750c7 (038750c78afd56c7becf744cf7dc4f8d115793d3) pacific (dev) , 1: /lib64/libpthread.so.0(+0x12dc0) [0x7f3c123cbdc0] , 2: gsignal() Ignoring malparsed backtrace: 2020-10-31T10:07:54.693 INFO:teuthology.orchestra.run.smithi159:> sudo lsb_release -is , 2020-10-31T10:07:54.740 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS , 2020-10-31T10:07:54.740 DEBUG:teuthology.misc:System to be installed: CentOS Ignoring malparsed backtrace: ceph version 16.0.0-6771-g038750c7 (038750c78afd56c7becf744cf7dc4f8d115793d3) pacific (dev) , 1: /lib64/libpthread.so.0(+0x12dc0) [0x7f3c123cbdc0] , 2: gsignal() Ignoring malparsed backtrace: 2020-10-31T10:07:54.693 INFO:teuthology.orchestra.run.smithi159:> sudo lsb_release -is , 2020-10-31T10:07:54.740 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS , 2020-10-31T10:07:54.740 DEBUG:teuthology.misc:System to be installed: CentOS Ignoring malparsed backtrace: ceph version 16.0.0-6771-g038750c7 (038750c78afd56c7becf744cf7dc4f8d115793d3) pacific (dev) , 1: /lib64/libpthread.so.0(+0x12dc0) [0x7f3c123cbdc0] , 2: gsignal() Ignoring malparsed backtrace: 2020-10-31T10:07:54.693 INFO:teuthology.orchestra.run.smithi159:> sudo lsb_release -is , 2020-10-31T10:07:54.740 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS , 2020-10-31T10:07:54.740 DEBUG:teuthology.misc:System to be installed: CentOS Ignoring malparsed backtrace: ceph version 16.0.0-6771-g038750c7 (038750c78afd56c7becf744cf7dc4f8d115793d3) pacific (dev) , 1: /lib64/libpthread.so.0(+0x12dc0) [0x7f3c123cbdc0] , 2: gsignal() Ignoring malparsed backtrace: 2020-10-31T10:07:54.693 INFO:teuthology.orchestra.run.smithi159:> sudo lsb_release -is , 2020-10-31T10:07:54.740 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS , 2020-10-31T10:07:54.740 DEBUG:teuthology.misc:System to be installed: CentOS Ignoring malparsed backtrace: ceph version 16.0.0-6771-g038750c7 (038750c78afd56c7becf744cf7dc4f8d115793d3) pacific (dev) , 1: /lib64/libpthread.so.0(+0x12dc0) [0x7f3c123cbdc0] , 2: gsignal() Ignoring malparsed backtrace: 2020-10-31T10:07:54.693 INFO:teuthology.orchestra.run.smithi159:> sudo lsb_release -is , 2020-10-31T10:07:54.740 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS , 2020-10-31T10:07:54.740 DEBUG:teuthology.misc:System to be installed: CentOS Found 9 distinct failure reasons Failure: Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-54d1ab60-1b5c-11eb-a2ad-001a4aab830c@mon.a' 79 jobs suites intersection: [] suites union: ['1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'rados', 'rados/cephadm/dashboard/{distro/centos_latest', 'rados/cephadm/smoke-roleless/{distro/centos_8.0', 'rados/cephadm/smoke-roleless/{distro/centos_latest', 'rados/cephadm/smoke-roleless/{distro/rhel_8.0', 'rados/cephadm/smoke-roleless/{distro/rhel_latest', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke-roleless/{distro/ubuntu_latest', 'rados/cephadm/smoke/{distro/centos_8.0', 'rados/cephadm/smoke/{distro/centos_latest', 'rados/cephadm/smoke/{distro/rhel_8.0', 'rados/cephadm/smoke/{distro/rhel_latest', 'rados/cephadm/smoke/{distro/ubuntu_18.04', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke/{distro/ubuntu_latest', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/cephadm/with-work/{distro/centos_8.0', 'rados/cephadm/with-work/{distro/centos_latest', 'rados/cephadm/with-work/{distro/rhel_8.0', 'rados/cephadm/with-work/{distro/rhel_latest', 'rados/cephadm/with-work/{distro/ubuntu_18.04', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'start', 'start}', 'task/test_e2e}', 'task/test_orch_cli}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] Dead: b'2020-10-31T21:16:41.326 DEBUG:teuthology.exit:Finished running handlers' 6 jobs: ['5578259', '5578039', '5578166', '5578217', '5578076', '5578122'] suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{centos_8.0}', 'distro$/{centos_latest}', 'distro$/{ubuntu_18.04_podman}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] Failure: Command failed (workunit test scrub/osd-recovery-scrub.sh) on smithi181 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=038750c78afd56c7becf744cf7dc4f8d115793d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh' 1 jobs: ['5578170'] suites: ['rados/standalone/{mon_election/classic', 'supported-random-distro$/{rhel_8}', 'workloads/scrub}'] Timeout 120 running ceph --cluster ceph osd dump --format=json 1 jobs: ['5578111'] suites: ['ceph', 'clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{default}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] Failure: psutil.NoSuchProcess process no longer exists (pid=19595) 2 jobs: ['5578348', '5578308'] suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{rhel_8.0}', 'distro$/{ubuntu_18.04_podman}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] Failure: Command failed (workunit test rados/test.sh) on smithi078 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=038750c78afd56c7becf744cf7dc4f8d115793d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 1 jobs: ['5578289'] suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-filestore 20 --debug-bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\'' 1 jobs: ['5578340'] suites: ['rados/objectstore/{backends/objectstore', 'supported-random-distro$/{centos_8}}'] Failure: Command failed on smithi140 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' 1 jobs: ['5578346'] suites: ['rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman', 'start}'] Timeout 3h running clone.client.0/qa/workunits/mon/caps.sh 2 jobs: ['5578335', '5578118'] suites intersection: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'rados', 'rados/monthrash/{ceph', 'workloads/rados_mon_workunits}'] suites union: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/force-sync-many', 'thrashers/sync', 'workloads/rados_mon_workunits}']