2023-07-27T02:52:49.420 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-27T02:52:49.421 INFO:teuthology.results:seed: '9450'
2023-07-27T03:13:38.031 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-27T03:13:38.035 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-07-27T03:48:44.800 INFO:teuthology.results:Tests finished! gathering results...
2023-07-27T03:49:00.809 INFO:scrape:Found 30 jobs
2023-07-27T03:49:00.810 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354241/teuthology.log
2023-07-27T03:49:00.811 INFO:scrape:Found 1 distinct failure reasons
2023-07-27T03:49:00.811 INFO:scrape:Dead: None
2023-07-27T03:49:00.811 INFO:scrape:7 jobs: ['7354241', '7354240', '7354238', '7354217', '7354227', '7354239', '7354235']
2023-07-27T03:49:00.812 INFO:scrape:
2023-07-27T03:49:00.813 INFO:teuthology.results:Sending results to jcollin@redhat.com: Test Run: jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/
failed:  0
dead:    7
running: 0
waiting: 0
queued:  0
passed:  23


Dead
=================================================================
[7354217]  fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354217/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354217/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7354227]  fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354227/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354227/

    Error reimaging machines: Failed to power on smithi078

[7354235]  fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354235/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354235/

    Error reimaging machines: Failed to power on smithi088

[7354238]  fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354238/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354238/

    Error reimaging machines: Expected smithi067's OS to be rhel 8.6 but found
    rhel 8.4

[7354239]  fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354239/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354239/

    Error reimaging machines: Expected smithi125's OS to be rhel 8.6 but found
    rhel 8.4

[7354240]  fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354240/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354240/

    Error reimaging machines: Expected smithi187's OS to be rhel 8.6 but found
    centos 8

[7354241]  fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354241/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354241/

    Error reimaging machines: Expected smithi148's OS to be rhel 8.6 but found
    centos 8



Pass
=================================================================
[7354214] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:26:40
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354214/

[7354215] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:26:32
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354215/

[7354216] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:32:04
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354216/

[7354218] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:27:33
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354218/

[7354219] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:25:14
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354219/

[7354220] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:27:26
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354220/

[7354221] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:25:54
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354221/

[7354222] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:25:25
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354222/

[7354223] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:30:17
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354223/

[7354224] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:25:23
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354224/

[7354225] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:24:24
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354225/

[7354226] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:26:13
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354226/

[7354228] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:23:51
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354228/

[7354229] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:26:04
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354229/

[7354230] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:30:43
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354230/

[7354231] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:24:37
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354231/

[7354232] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:24:43
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354232/

[7354233] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:27:51
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354233/

[7354234] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:24:56
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354234/

[7354236] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:23:23
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354236/

[7354237] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:32:40
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354237/

[7354242] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:26:15
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354242/

[7354243] fs:mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   00:26:36
info:   http://pulpito.ceph.com/jcollin-2023-07-27_02:35:51-fs:mirror-ha-wip-cephfs-mirror-fix_reef-distro-default-smithi/7354243/