2023-07-27T01:49:19.661 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-27T01:49:19.662 INFO:teuthology.results:seed: '9847' 2023-07-27T02:03:02.888 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-27T02:03:02.892 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-27T05:23:38.962 INFO:teuthology.results:Tests finished! gathering results... 2023-07-27T05:23:48.907 INFO:scrape:Found 30 jobs 2023-07-27T05:23:49.311 INFO:scrape:Found 1 distinct failure reasons 2023-07-27T05:23:49.312 INFO:scrape:Failure: Command failed on smithi158 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2023-07-27T05:23:49.312 INFO:scrape:1 jobs: ['7354177'] 2023-07-27T05:23:49.312 INFO:scrape:suites: ['2-three-per-cluster}', 'cephfs-mirror/{1-volume-create-rm', 'clients/{mirror}', 'cluster/{1-node}', 'fs:mirror-ha/{begin', 'objectstore/bluestore-bitmap', 'overrides/{whitelist_health}', 'supported-random-distro$/{centos_8}', 'workloads/cephfs-mirror-ha-workunit}'] 2023-07-27T05:23:49.313 INFO:scrape: 2023-07-27T05:23:49.315 INFO:teuthology.results:Sending results to jcollin@redhat.com: Test Run: jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 29 Fail ================================================================= [7354177] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} ----------------------------------------------------------------- time: 02:58:02 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354177/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354177/ Command failed on smithi158 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' Pass ================================================================= [7354150] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 03:00:51 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354150/ [7354151] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:53:53 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354151/ [7354152] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 03:00:22 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354152/ [7354153] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:54:36 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354153/ [7354154] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:58:10 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354154/ [7354155] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 03:00:06 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354155/ [7354156] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:58:10 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354156/ [7354157] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:58:44 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354157/ [7354158] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:58:14 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354158/ [7354159] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 03:04:11 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354159/ [7354160] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:54:49 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354160/ [7354161] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 03:02:18 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354161/ [7354162] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:57:19 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354162/ [7354163] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:57:54 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354163/ [7354164] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:56:28 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354164/ [7354165] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:57:43 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354165/ [7354166] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:57:29 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354166/ [7354167] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:56:15 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354167/ [7354168] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 03:00:18 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354168/ [7354169] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:55:14 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354169/ [7354170] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:56:13 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354170/ [7354171] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:57:45 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354171/ [7354172] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:54:49 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354172/ [7354173] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:57:41 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354173/ [7354174] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:57:37 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354174/ [7354175] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:59:38 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354175/ [7354176] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:56:58 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354176/ [7354178] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:55:14 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354178/ [7354179] fs:mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{centos_8} workloads/cephfs-mirror-ha-workunit} time: 02:58:18 info: http://pulpito.ceph.com/jcollin-2023-07-27_01:48:11-fs:mirror-ha-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354179/