2021-12-30T05:01:00.273 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-30T05:01:00.275 INFO:teuthology.results:seed: '4377' 2021-12-30T05:34:14.361 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-30T05:34:14.392 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-12-30T07:06:21.021 INFO:teuthology.results:Tests finished! gathering results... 2021-12-30T07:06:22.776 INFO:scrape:Found 24 jobs 2021-12-30T07:06:23.396 INFO:scrape:Found 2 distinct failure reasons 2021-12-30T07:06:23.397 INFO:scrape:Failure: Command failed on smithi194 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2021-12-30T07:06:23.397 INFO:scrape:1 jobs: ['6588547'] 2021-12-30T07:06:23.398 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install', 'test/kclient_workunit_suites_pjd}}'] 2021-12-30T07:06:23.398 INFO:scrape: 2021-12-30T07:06:23.398 INFO:scrape:Failure: "2021-12-30T05:43:50.350178+0000 mon.a (mon.0) 259 : cluster [WRN] Health check failed: Degraded data redundancy: 1/50 objects degraded (2.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2021-12-30T07:06:23.399 INFO:scrape:1 jobs: ['6588553'] 2021-12-30T07:06:23.399 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install', 'test/rados_cls_all}}'] 2021-12-30T07:06:23.400 INFO:scrape: 2021-12-30T07:06:23.401 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 22 Fail ================================================================= [6588547] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/kclient_workunit_suites_pjd}} ----------------------------------------------------------------- time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588547/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588547/ sentry: https://sentry.ceph.com/organizations/ceph/?query=40182f1bdb8c447d9548755d1b881a03 Command failed on smithi194 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' [6588553] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_cls_all}} ----------------------------------------------------------------- time: 00:20:59 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588553/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588553/ "2021-12-30T05:43:50.350178+0000 mon.a (mon.0) 259 : cluster [WRN] Health check failed: Degraded data redundancy: 1/50 objects degraded (2.000%), 1 pg degraded (PG_DEGRADED)" in cluster log Pass ================================================================= [6588540] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/cfuse_workunit_suites_blogbench}} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588540/ [6588541] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/{0-install test/cfuse_workunit_suites_fsstress}} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588541/ [6588542] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/cfuse_workunit_suites_iozone}} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588542/ [6588543] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/{0-install test/cfuse_workunit_suites_pjd}} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588543/ [6588544] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/{0-install test/kclient_workunit_direct_io}} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588544/ [6588545] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/{0-install test/kclient_workunit_suites_dbench}} time: 01:11:57 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588545/ [6588546] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/kclient_workunit_suites_fsstress}} time: 00:25:42 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588546/ [6588548] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/libcephfs_interface_tests}} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588548/ [6588549] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/mon_thrash}} time: 00:34:02 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588549/ [6588550] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_api_tests}} time: 00:46:16 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588550/ [6588551] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_bench}} time: 01:31:53 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588551/ [6588552] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_cache_snaps}} time: 00:25:01 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588552/ [6588554] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_ec_snaps}} time: 00:28:24 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588554/ [6588555] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_python}} time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588555/ [6588556] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_workunit_loadgen_mix}} time: 00:22:37 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588556/ [6588557] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/{0-install test/rbd_api_tests}} time: 00:27:52 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588557/ [6588558] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_cli_import_export}} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588558/ [6588559] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rbd_fsx}} time: 00:12:59 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588559/ [6588560] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rbd_python_api_tests}} time: 00:22:16 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588560/ [6588561] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/{0-install test/rbd_workunit_suites_iozone}} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588561/ [6588562] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rgw_ec_s3tests}} time: 00:36:53 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588562/ [6588563] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rgw_s3tests}} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2021-12-30_05:00:02-smoke-master-distro-default-smithi/6588563/