2023-01-25T04:35:46.711 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T04:35:46.712 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136766 --verbose --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136766/orig.config.yaml 2023-01-25T04:35:46.771 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T04:35:46.855 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136766 branch: wip-yuri-testing-2023-01-23-0926 description: rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} email: yweinstein@radhat.com first_in_suite: false job_id: '7136766' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-yuri-testing-2023-01-23-0926 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_async_recovery_min_cost: 1 osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_object_clean_region_max_num_intervals: 1000 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd mclock override recovery settings: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - must scrub before tier agent can activate sha1: b0d2592529629ab4f86fed5991e556a87dcda563 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b0d2592529629ab4f86fed5991e556a87dcda563 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 min_in: 4 workunit: branch: wip-yuri-testing-2023-01-23-0926 sha1: b0d2592529629ab4f86fed5991e556a87dcda563 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: b0d2592529629ab4f86fed5991e556a87dcda563 sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri-testing-2023-01-23-0926 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b0d2592529629ab4f86fed5991e556a87dcda563/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b0d2592529629ab4f86fed5991e556a87dcda563 targets: smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: bluestore_new_sharding: random chance_bluestore_reshard: 1 chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 timeout: 1200 - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - sudo ceph osd pool set cache min_read_recency_for_promote 2 - sudo ceph osd pool set cache min_write_recency_for_promote 2 - rados: clients: - client.0 objects: 500 op_weights: copy_from: 50 delete: 50 read: 100 write: 100 ops: 4000 pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:20:59 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T04:35:46.856 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b0d2592529629ab4f86fed5991e556a87dcda563/qa; will attempt to use it 2023-01-25T04:35:46.857 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b0d2592529629ab4f86fed5991e556a87dcda563/qa/tasks 2023-01-25T04:35:46.857 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T04:35:46.859 INFO:teuthology.task.internal:Checking packages... 2023-01-25T04:35:46.892 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'b0d2592529629ab4f86fed5991e556a87dcda563' 2023-01-25T04:35:46.892 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T04:35:46.893 INFO:teuthology.packaging:ref: None 2023-01-25T04:35:46.893 INFO:teuthology.packaging:tag: None 2023-01-25T04:35:46.893 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-01-23-0926 2023-01-25T04:35:46.894 INFO:teuthology.packaging:sha1: b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:35:46.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-01-23-0926 2023-01-25T04:35:47.050 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1959.gb0d25925 2023-01-25T04:35:47.050 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T04:35:47.056 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T04:35:47.057 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T04:35:47.085 INFO:teuthology.task.internal:Saving configuration 2023-01-25T04:35:47.106 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T04:35:47.124 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T04:35:47.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136766', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 04:30:37.561330', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-01-25T04:35:47.180 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136766', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 04:30:37.559525', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-01-25T04:35:47.180 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T04:35:47.187 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-25T04:35:47.188 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-25T04:35:47.188 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T04:35:47.281 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fabe1fc45e0>, signals=[15]) 2023-01-25T04:35:47.282 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T04:35:47.288 INFO:teuthology.task.internal:Opening connections... 2023-01-25T04:35:47.289 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2023-01-25T04:35:47.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:35:47.361 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2023-01-25T04:35:47.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:35:47.430 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T04:35:47.436 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-01-25T04:35:47.456 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-01-25T04:35:47.457 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-01-25T04:35:47.514 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-01-25T04:35:47.515 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-01-25T04:35:47.515 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-01-25T04:35:47.515 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-01-25T04:35:47.515 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-01-25T04:35:47.516 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-01-25T04:35:47.516 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-25T04:35:47.516 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-01-25T04:35:47.516 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-25T04:35:47.516 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-01-25T04:35:47.517 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-25T04:35:47.517 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T04:35:47.517 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:35:47.517 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T04:35:47.517 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-25T04:35:47.518 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-25T04:35:47.518 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-25T04:35:47.519 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-01-25T04:35:47.534 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-01-25T04:35:47.555 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-01-25T04:35:47.555 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-01-25T04:35:47.614 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2023-01-25T04:35:47.615 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2023-01-25T04:35:47.615 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2023-01-25T04:35:47.615 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2023-01-25T04:35:47.615 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2023-01-25T04:35:47.616 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-01-25T04:35:47.616 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-25T04:35:47.617 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-01-25T04:35:47.617 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-25T04:35:47.617 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2023-01-25T04:35:47.617 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-25T04:35:47.618 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T04:35:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:35:47.618 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T04:35:47.618 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-25T04:35:47.618 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-25T04:35:47.619 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-25T04:35:47.619 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-01-25T04:35:47.636 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T04:35:47.646 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T04:35:47.692 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T04:35:47.693 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2023-01-25T04:35:47.696 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2023-01-25T04:35:47.714 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T04:35:47.727 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T04:35:47.727 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2023-01-25T04:35:47.754 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2023-01-25T04:35:47.774 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T04:35:47.828 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T04:35:47.843 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T04:35:47.844 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T04:35:47.844 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T04:35:47.845 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T04:35:47.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:35:47.862 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-01-25T04:35:47.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:35:47.863 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-01-25T04:35:47.919 INFO:teuthology.orchestra.run.smithi149.stdout:4.18.0-372.9.1.el8.x86_64 2023-01-25T04:35:47.919 INFO:teuthology.task.kernel:Running kernel on smithi149: 4.18.0-372.9.1.el8.x86_64 2023-01-25T04:35:47.920 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2023-01-25T04:35:47.921 INFO:teuthology.orchestra.run.smithi154.stdout:4.18.0-372.9.1.el8.x86_64 2023-01-25T04:35:47.921 INFO:teuthology.task.kernel:Running kernel on smithi154: 4.18.0-372.9.1.el8.x86_64 2023-01-25T04:35:47.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2023-01-25T04:35:49.029 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:35:49.029 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-01-25T04:35:49.131 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:35:49.132 INFO:teuthology.orchestra.run.smithi154.stdout:Unable to read consumer identity 2023-01-25T04:35:50.586 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-01-25T04:35:50.593 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-01-25T04:35:52.812 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 6.0 MB/s | 13 MB 00:02 2023-01-25T04:35:53.994 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 13 MB 00:03 2023-01-25T04:35:55.828 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 396 kB/s | 24 kB 00:00 2023-01-25T04:35:56.489 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-01-25T04:35:56.547 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:35:56.548 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:35:56.549 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:35:56.676 DEBUG:teuthology.orchestra.run.smithi149:> echo no | sudo yum reinstall kernel || true 2023-01-25T04:35:57.008 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:35:57.008 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-01-25T04:35:57.027 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 182 kB/s | 24 kB 00:00 2023-01-25T04:35:57.271 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:02 ago on Wed 25 Jan 2023 04:35:55 AM UTC. 2023-01-25T04:35:57.315 INFO:teuthology.orchestra.run.smithi149.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-25T04:35:57.359 INFO:teuthology.orchestra.run.smithi149.stderr:Error: No packages marked for reinstall. 2023-01-25T04:35:57.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum reinstall -y kernel || true 2023-01-25T04:35:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-01-25T04:35:57.734 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:35:57.736 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:35:57.736 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:35:57.737 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:35:57.737 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-01-25T04:35:57.875 DEBUG:teuthology.orchestra.run.smithi154:> echo no | sudo yum reinstall kernel || true 2023-01-25T04:35:58.001 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:02 ago on Wed 25 Jan 2023 04:35:55 AM UTC. 2023-01-25T04:35:58.040 INFO:teuthology.orchestra.run.smithi149.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-25T04:35:58.081 INFO:teuthology.orchestra.run.smithi149.stderr:Error: No packages marked for reinstall. 2023-01-25T04:35:58.134 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel --last | head -n 1 2023-01-25T04:35:58.206 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:35:58.207 INFO:teuthology.orchestra.run.smithi154.stdout:Unable to read consumer identity 2023-01-25T04:35:58.215 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-01-25T04:35:58.216 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-01-25T04:35:58.217 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-25T04:35:58.217 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T04:35:58.217 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T04:35:58.248 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2023-01-25T04:35:58.264 DEBUG:teuthology.parallel:result is None 2023-01-25T04:35:58.459 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:02 ago on Wed 25 Jan 2023 04:35:56 AM UTC. 2023-01-25T04:35:58.500 INFO:teuthology.orchestra.run.smithi154.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-25T04:35:58.538 INFO:teuthology.orchestra.run.smithi154.stderr:Error: No packages marked for reinstall. 2023-01-25T04:35:58.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum reinstall -y kernel || true 2023-01-25T04:35:58.914 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:35:58.915 INFO:teuthology.orchestra.run.smithi154.stdout:Unable to read consumer identity 2023-01-25T04:35:59.169 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:03 ago on Wed 25 Jan 2023 04:35:56 AM UTC. 2023-01-25T04:35:59.208 INFO:teuthology.orchestra.run.smithi154.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-25T04:35:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:Error: No packages marked for reinstall. 2023-01-25T04:35:59.298 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel --last | head -n 1 2023-01-25T04:35:59.378 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-01-25T04:35:59.379 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-01-25T04:35:59.379 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-25T04:35:59.380 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-25T04:35:59.380 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T04:35:59.411 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2023-01-25T04:35:59.424 DEBUG:teuthology.parallel:result is None 2023-01-25T04:35:59.424 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T04:35:59.431 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T04:35:59.432 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T04:35:59.435 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T04:35:59.481 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T04:35:59.491 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T04:35:59.525 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T04:35:59.526 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T04:35:59.528 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T04:35:59.567 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T04:35:59.576 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T04:35:59.576 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T04:35:59.603 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T04:35:59.656 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:35:59.657 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:35:59.666 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:35:59.669 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:35:59.670 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T04:35:59.678 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T04:35:59.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T04:35:59.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T04:35:59.708 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T04:35:59.718 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T04:35:59.718 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T04:35:59.750 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T04:35:59.767 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:35:59.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:35:59.901 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:35:59.983 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:36:00.031 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:36:00.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T04:36:00.100 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:36:00.141 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:36:00.203 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:36:00.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:36:00.287 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:36:00.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T04:36:00.354 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2023-01-25T04:36:00.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2023-01-25T04:36:00.418 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T04:36:00.447 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T04:36:00.823 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T04:36:00.831 INFO:teuthology.task.internal:Starting timer... 2023-01-25T04:36:00.832 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T04:36:00.881 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T04:36:00.911 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-25T04:36:00.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2023-01-25T04:36:00.980 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2023-01-25T04:36:00.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2023-01-25T04:36:01.041 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2023-01-25T04:36:01.043 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T04:36:01.043 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2023-01-25T04:36:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2023-01-25T04:36:01.070 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2023-01-25T04:36:01.089 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2023-01-25T04:36:01.090 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi149.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2023-01-25T04:36:01.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T04:36:01.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:36:01.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T04:36:01.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:36:01.163 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T04:36:01.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2023-01-25T04:36:01.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2023-01-25T04:36:01.229 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T04:36:01.240 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-25T04:36:01.240 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T04:36:01.256 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T04:36:01.257 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi149.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T04:42:47.815 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi149.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2023-01-25T04:42:47.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-25T04:42:47.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:42:47.885 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-01-25T04:42:47.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-01-25T04:42:47.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:42:48.024 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-01-25T04:42:48.090 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T04:42:48.102 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T04:42:48.102 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T04:42:48.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T04:42:48.108 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T04:42:48.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T04:42:48.135 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T04:42:48.151 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T04:42:48.163 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T04:42:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T04:42:48.223 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2023-01-25T04:42:48.235 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2023-01-25T04:42:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2023-01-25T04:42:48.251 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T04:42:48.256 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2023-01-25T04:42:48.264 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T04:42:48.271 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T04:42:48.285 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T04:42:48.341 INFO:teuthology.orchestra.run.smithi149.stderr:bash: ntpq: command not found 2023-01-25T04:42:48.344 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T04:42:48.345 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2023-01-25T04:42:48.345 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:42:48.345 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:42:48.348 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:42:48.348 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:42:48.357 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2023-01-25T04:42:48.361 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T04:42:48.362 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2023-01-25T04:42:48.362 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:42:48.362 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:42:48.362 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:42:48.362 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:42:48.363 INFO:teuthology.run_tasks:Running task install... 2023-01-25T04:42:48.372 DEBUG:teuthology.task.install:project ceph 2023-01-25T04:42:48.372 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}} 2023-01-25T04:42:48.373 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'} 2023-01-25T04:42:48.373 INFO:teuthology.task.install:Using flavor: default 2023-01-25T04:42:48.380 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T04:42:48.380 INFO:teuthology.task.install:extra packages: [] 2023-01-25T04:42:48.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-25T04:42:48.430 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2023-01-25T04:42:48.432 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T04:42:48.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo lsb_release -is 2023-01-25T04:42:48.433 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'tag': None, 'wait_for_package': False} 2023-01-25T04:42:48.434 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-25T04:42:48.475 INFO:teuthology.orchestra.run.smithi154.stdout:RedHatEnterprise 2023-01-25T04:42:48.476 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T04:42:48.476 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'tag': None, 'wait_for_package': False} 2023-01-25T04:42:48.477 DEBUG:teuthology.orchestra.run.smithi154:> sudo lsb_release -is 2023-01-25T04:42:48.513 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2023-01-25T04:42:48.514 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T04:42:48.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:42:48.558 INFO:teuthology.orchestra.run.smithi154.stdout:RedHatEnterprise 2023-01-25T04:42:48.559 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T04:42:48.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:42:48.674 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/ 2023-01-25T04:42:48.675 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1959.gb0d25925 2023-01-25T04:42:48.708 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/ 2023-01-25T04:42:48.709 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1959.gb0d25925 2023-01-25T04:42:48.789 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T04:42:48.789 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:42:48.789 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T04:42:48.817 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T04:42:48.817 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0d2592529629ab4f86fed5991e556a87dcda563/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T04:42:48.825 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T04:42:48.826 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:42:48.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T04:42:48.853 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T04:42:48.854 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0d2592529629ab4f86fed5991e556a87dcda563/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T04:42:48.884 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T04:42:48.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T04:42:48.963 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T04:42:49.001 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T04:42:49.028 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2023-01-25T04:42:49.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2023-01-25T04:42:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2023-01-25T04:42:49.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2023-01-25T04:42:49.400 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:42:49.440 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:42:49.644 INFO:teuthology.orchestra.run.smithi149.stdout:44 files removed 2023-01-25T04:42:49.686 INFO:teuthology.orchestra.run.smithi154.stdout:44 files removed 2023-01-25T04:42:49.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw 2023-01-25T04:42:49.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw 2023-01-25T04:42:50.023 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:42:50.069 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:42:50.661 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 287 kB/s | 80 kB 00:00 2023-01-25T04:42:50.694 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 292 kB/s | 80 kB 00:00 2023-01-25T04:42:50.945 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 37 kB/s | 9.3 kB 00:00 2023-01-25T04:42:50.969 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 38 kB/s | 9.3 kB 00:00 2023-01-25T04:42:51.204 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 6.3 kB/s | 1.5 kB 00:00 2023-01-25T04:42:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-01-25T04:42:51.362 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-01-25T04:42:51.371 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-01-25T04:42:52.330 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2023-01-25T04:42:52.380 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:00 2023-01-25T04:42:55.397 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 262 kB/s | 24 kB 00:00 2023-01-25T04:42:55.472 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 220 kB/s | 24 kB 00:00 2023-01-25T04:42:56.274 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-01-25T04:42:56.333 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-01-25T04:43:04.199 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-01-25T04:43:04.224 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-01-25T04:43:15.233 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:43:15.236 INFO:teuthology.orchestra.run.smithi149.stdout:==================================================================================================== 2023-01-25T04:43:15.236 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:43:15.237 INFO:teuthology.orchestra.run.smithi149.stdout:==================================================================================================== 2023-01-25T04:43:15.237 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:43:15.237 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 13 M 2023-01-25T04:43:15.237 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2023-01-25T04:43:15.237 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.6 M 2023-01-25T04:43:15.238 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.6 M 2023-01-25T04:43:15.238 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-25T04:43:15.238 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 5.2 M 2023-01-25T04:43:15.238 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 24 M 2023-01-25T04:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 24 k 2023-01-25T04:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T04:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 768 k 2023-01-25T04:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T04:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-01-25T04:43:15.240 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 474 k 2023-01-25T04:43:15.240 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-01-25T04:43:15.240 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 6.5 M 2023-01-25T04:43:15.240 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T04:43:15.241 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-01-25T04:43:15.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 45 k 2023-01-25T04:43:15.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 115 k 2023-01-25T04:43:15.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 190 k 2023-01-25T04:43:15.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-01-25T04:43:15.242 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 372 k 2023-01-25T04:43:15.242 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 364 k 2023-01-25T04:43:15.242 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 107 k 2023-01-25T04:43:15.242 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T04:43:15.242 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:43:15.243 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:43:15.243 INFO:teuthology.orchestra.run.smithi149.stdout:==================================================================================================== 2023-01-25T04:43:15.243 INFO:teuthology.orchestra.run.smithi149.stdout:Install 21 Packages 2023-01-25T04:43:15.243 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2023-01-25T04:43:15.243 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:43:15.244 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 62 M 2023-01-25T04:43:15.244 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:43:15.347 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:43:15.350 INFO:teuthology.orchestra.run.smithi154.stdout:==================================================================================================== 2023-01-25T04:43:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:43:15.350 INFO:teuthology.orchestra.run.smithi154.stdout:==================================================================================================== 2023-01-25T04:43:15.351 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:43:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 13 M 2023-01-25T04:43:15.351 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2023-01-25T04:43:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.6 M 2023-01-25T04:43:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.6 M 2023-01-25T04:43:15.352 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-01-25T04:43:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 5.2 M 2023-01-25T04:43:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 24 M 2023-01-25T04:43:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 24 k 2023-01-25T04:43:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T04:43:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 768 k 2023-01-25T04:43:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T04:43:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-01-25T04:43:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 474 k 2023-01-25T04:43:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-01-25T04:43:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 6.5 M 2023-01-25T04:43:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T04:43:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-01-25T04:43:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 45 k 2023-01-25T04:43:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 115 k 2023-01-25T04:43:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 190 k 2023-01-25T04:43:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-01-25T04:43:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 372 k 2023-01-25T04:43:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 364 k 2023-01-25T04:43:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 107 k 2023-01-25T04:43:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T04:43:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:43:15.356 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:43:15.356 INFO:teuthology.orchestra.run.smithi154.stdout:==================================================================================================== 2023-01-25T04:43:15.357 INFO:teuthology.orchestra.run.smithi154.stdout:Install 21 Packages 2023-01-25T04:43:15.357 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 2 Packages 2023-01-25T04:43:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:43:15.358 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 62 M 2023-01-25T04:43:15.358 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:43:16.174 INFO:teuthology.orchestra.run.smithi149.stdout:(1/23): ceph-base-18.0.0-1959.gb0d25925.el8.x86 5.6 MB/s | 5.2 MB 00:00 2023-01-25T04:43:16.250 INFO:teuthology.orchestra.run.smithi149.stdout:(2/23): ceph-selinux-18.0.0-1959.gb0d25925.el8. 324 kB/s | 24 kB 00:00 2023-01-25T04:43:16.425 INFO:teuthology.orchestra.run.smithi149.stdout:(3/23): libcephfs2-18.0.0-1959.gb0d25925.el8.x8 4.3 MB/s | 768 kB 00:00 2023-01-25T04:43:16.542 INFO:teuthology.orchestra.run.smithi149.stdout:(4/23): libradosstriper1-18.0.0-1959.gb0d25925. 4.0 MB/s | 474 kB 00:00 2023-01-25T04:43:17.090 INFO:teuthology.orchestra.run.smithi154.stdout:(1/23): ceph-base-18.0.0-1959.gb0d25925.el8.x86 3.0 MB/s | 5.2 MB 00:01 2023-01-25T04:43:17.149 INFO:teuthology.orchestra.run.smithi154.stdout:(2/23): ceph-selinux-18.0.0-1959.gb0d25925.el8. 415 kB/s | 24 kB 00:00 2023-01-25T04:43:17.150 INFO:teuthology.orchestra.run.smithi149.stdout:(5/23): ceph-radosgw-18.0.0-1959.gb0d25925.el8. 6.8 MB/s | 13 MB 00:01 2023-01-25T04:43:17.226 INFO:teuthology.orchestra.run.smithi149.stdout:(6/23): python3-ceph-argparse-18.0.0-1959.gb0d2 596 kB/s | 45 kB 00:00 2023-01-25T04:43:17.301 INFO:teuthology.orchestra.run.smithi149.stdout:(7/23): python3-ceph-common-18.0.0-1959.gb0d259 1.5 MB/s | 115 kB 00:00 2023-01-25T04:43:17.366 INFO:teuthology.orchestra.run.smithi154.stdout:(3/23): libcephfs2-18.0.0-1959.gb0d25925.el8.x8 3.5 MB/s | 768 kB 00:00 2023-01-25T04:43:17.376 INFO:teuthology.orchestra.run.smithi149.stdout:(8/23): python3-cephfs-18.0.0-1959.gb0d25925.el 2.5 MB/s | 190 kB 00:00 2023-01-25T04:43:17.468 INFO:teuthology.orchestra.run.smithi149.stdout:(9/23): python3-rados-18.0.0-1959.gb0d25925.el8 4.0 MB/s | 372 kB 00:00 2023-01-25T04:43:17.499 INFO:teuthology.orchestra.run.smithi154.stdout:(4/23): libradosstriper1-18.0.0-1959.gb0d25925. 3.5 MB/s | 474 kB 00:00 2023-01-25T04:43:17.552 INFO:teuthology.orchestra.run.smithi149.stdout:(10/23): python3-rbd-18.0.0-1959.gb0d25925.el8. 4.3 MB/s | 364 kB 00:00 2023-01-25T04:43:17.627 INFO:teuthology.orchestra.run.smithi149.stdout:(11/23): librgw2-18.0.0-1959.gb0d25925.el8.x86_ 6.0 MB/s | 6.5 MB 00:01 2023-01-25T04:43:17.652 INFO:teuthology.orchestra.run.smithi149.stdout:(12/23): python3-rgw-18.0.0-1959.gb0d25925.el8. 1.0 MB/s | 107 kB 00:00 2023-01-25T04:43:17.794 INFO:teuthology.orchestra.run.smithi149.stdout:(13/23): liboath-2.6.2-3.el8.x86_64.rpm 415 kB/s | 59 kB 00:00 2023-01-25T04:43:17.853 INFO:teuthology.orchestra.run.smithi149.stdout:(14/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-01-25T04:43:17.870 INFO:teuthology.orchestra.run.smithi149.stdout:(15/23): libunwind-1.3.1-3.el8.x86_64.rpm 996 kB/s | 75 kB 00:00 2023-01-25T04:43:17.929 INFO:teuthology.orchestra.run.smithi149.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.4 MB/s | 259 kB 00:00 2023-01-25T04:43:18.171 INFO:teuthology.orchestra.run.smithi149.stdout:(17/23): ceph-common-18.0.0-1959.gb0d25925.el8. 8.3 MB/s | 24 MB 00:02 2023-01-25T04:43:18.196 INFO:teuthology.orchestra.run.smithi149.stdout:(18/23): python3-prettytable-0.7.2-14.el8.noarc 165 kB/s | 44 kB 00:00 2023-01-25T04:43:18.238 INFO:teuthology.orchestra.run.smithi149.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 4.5 MB/s | 1.7 MB 00:00 2023-01-25T04:43:18.263 INFO:teuthology.orchestra.run.smithi149.stdout:(20/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 760 kB/s | 47 kB 00:00 2023-01-25T04:43:18.288 INFO:teuthology.orchestra.run.smithi149.stdout:(21/23): librdkafka-0.11.4-3.el8.x86_64.rpm 2.9 MB/s | 354 kB 00:00 2023-01-25T04:43:18.350 INFO:teuthology.orchestra.run.smithi154.stdout:(5/23): librgw2-18.0.0-1959.gb0d25925.el8.x86_6 7.6 MB/s | 6.5 MB 00:00 2023-01-25T04:43:18.417 INFO:teuthology.orchestra.run.smithi154.stdout:(6/23): python3-ceph-argparse-18.0.0-1959.gb0d2 671 kB/s | 45 kB 00:00 2023-01-25T04:43:18.492 INFO:teuthology.orchestra.run.smithi154.stdout:(7/23): python3-ceph-common-18.0.0-1959.gb0d259 1.5 MB/s | 115 kB 00:00 2023-01-25T04:43:18.576 INFO:teuthology.orchestra.run.smithi154.stdout:(8/23): python3-cephfs-18.0.0-1959.gb0d25925.el 2.2 MB/s | 190 kB 00:00 2023-01-25T04:43:18.668 INFO:teuthology.orchestra.run.smithi154.stdout:(9/23): python3-rados-18.0.0-1959.gb0d25925.el8 4.0 MB/s | 372 kB 00:00 2023-01-25T04:43:18.743 INFO:teuthology.orchestra.run.smithi154.stdout:(10/23): python3-rbd-18.0.0-1959.gb0d25925.el8. 4.8 MB/s | 364 kB 00:00 2023-01-25T04:43:18.781 INFO:teuthology.orchestra.run.smithi149.stdout:(22/23): librbd1-18.0.0-1959.gb0d25925.el8.x86_ 6.9 MB/s | 3.6 MB 00:00 2023-01-25T04:43:18.793 INFO:teuthology.orchestra.run.smithi154.stdout:(11/23): python3-rgw-18.0.0-1959.gb0d25925.el8. 2.1 MB/s | 107 kB 00:00 2023-01-25T04:43:18.840 INFO:teuthology.orchestra.run.smithi149.stdout:(23/23): librados2-18.0.0-1959.gb0d25925.el8.x8 6.1 MB/s | 3.6 MB 00:00 2023-01-25T04:43:18.842 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:43:18.842 INFO:teuthology.orchestra.run.smithi149.stdout:Total 17 MB/s | 62 MB 00:03 2023-01-25T04:43:18.886 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:43:18.931 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:43:18.931 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:43:18.985 INFO:teuthology.orchestra.run.smithi154.stdout:(12/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-01-25T04:43:19.036 INFO:teuthology.orchestra.run.smithi154.stdout:(13/23): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2023-01-25T04:43:19.086 INFO:teuthology.orchestra.run.smithi154.stdout:(14/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-01-25T04:43:19.268 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:43:19.272 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:43:19.361 INFO:teuthology.orchestra.run.smithi154.stdout:(15/23): ceph-radosgw-18.0.0-1959.gb0d25925.el8 3.3 MB/s | 13 MB 00:04 2023-01-25T04:43:19.403 INFO:teuthology.orchestra.run.smithi154.stdout:(16/23): thrift-0.13.0-2.el8.x86_64.rpm 5.5 MB/s | 1.7 MB 00:00 2023-01-25T04:43:19.454 INFO:teuthology.orchestra.run.smithi154.stdout:(17/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-01-25T04:43:19.478 INFO:teuthology.orchestra.run.smithi154.stdout:(18/23): python3-prettytable-0.7.2-14.el8.noarc 629 kB/s | 44 kB 00:00 2023-01-25T04:43:19.512 INFO:teuthology.orchestra.run.smithi154.stdout:(19/23): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-01-25T04:43:19.529 INFO:teuthology.orchestra.run.smithi154.stdout:(20/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 930 kB/s | 47 kB 00:00 2023-01-25T04:43:19.938 INFO:teuthology.orchestra.run.smithi154.stdout:(21/23): librados2-18.0.0-1959.gb0d25925.el8.x8 8.6 MB/s | 3.6 MB 00:00 2023-01-25T04:43:20.121 INFO:teuthology.orchestra.run.smithi154.stdout:(22/23): librbd1-18.0.0-1959.gb0d25925.el8.x86_ 6.0 MB/s | 3.6 MB 00:00 2023-01-25T04:43:20.486 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:43:20.714 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T04:43:20.899 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-25T04:43:20.930 INFO:teuthology.orchestra.run.smithi154.stdout:(23/23): ceph-common-18.0.0-1959.gb0d25925.el8. 4.4 MB/s | 24 MB 00:05 2023-01-25T04:43:20.932 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:43:20.932 INFO:teuthology.orchestra.run.smithi154.stdout:Total 11 MB/s | 62 MB 00:05 2023-01-25T04:43:20.976 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:43:21.019 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:43:21.019 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:43:21.297 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-25T04:43:21.355 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:43:21.359 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:43:21.482 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 3/25 2023-01-25T04:43:21.574 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 3/25 2023-01-25T04:43:21.755 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:43:21.987 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/25 2023-01-25T04:43:22.156 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 6/25 2023-01-25T04:43:22.551 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:43:22.552 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 6/25 2023-01-25T04:43:22.731 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:43:22.783 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T04:43:22.797 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:43:22.971 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T04:43:22.996 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-25T04:43:23.123 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:43:23.192 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:43:23.334 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8. 10/25 2023-01-25T04:43:23.394 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-25T04:43:23.534 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 11/25 2023-01-25T04:43:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 3/25 2023-01-25T04:43:23.671 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 3/25 2023-01-25T04:43:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:43:23.891 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 12/25 2023-01-25T04:43:24.039 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 13/25 2023-01-25T04:43:24.097 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 13/25 2023-01-25T04:43:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/25 2023-01-25T04:43:24.224 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 14/25 2023-01-25T04:43:24.320 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 6/25 2023-01-25T04:43:24.406 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/25 2023-01-25T04:43:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 6/25 2023-01-25T04:43:24.920 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:43:24.970 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:43:25.169 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T04:43:25.182 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/25 2023-01-25T04:43:25.320 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 17/25 2023-01-25T04:43:25.390 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:43:25.412 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 17/25 2023-01-25T04:43:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8. 10/25 2023-01-25T04:43:25.648 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 18/25 2023-01-25T04:43:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 11/25 2023-01-25T04:43:25.832 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x8 19/25 2023-01-25T04:43:25.929 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 12/25 2023-01-25T04:43:26.095 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 13/25 2023-01-25T04:43:26.169 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 13/25 2023-01-25T04:43:26.321 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 14/25 2023-01-25T04:43:26.533 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/25 2023-01-25T04:43:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/25 2023-01-25T04:43:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 17/25 2023-01-25T04:43:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 17/25 2023-01-25T04:43:27.761 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 18/25 2023-01-25T04:43:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x8 19/25 2023-01-25T04:43:29.676 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:43:29.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:43:30.483 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:43:30.752 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 21/25 2023-01-25T04:43:30.823 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 21/25 2023-01-25T04:43:30.980 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:43:31.950 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:43:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:43:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:43:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 21/25 2023-01-25T04:43:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 21/25 2023-01-25T04:43:33.352 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:43:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:43:49.707 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2023-01-25T04:43:49.707 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2023-01-25T04:43:49.707 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2023-01-25T04:43:49.707 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /run 2023-01-25T04:43:49.708 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2023-01-25T04:43:49.708 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2023-01-25T04:43:49.708 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2023-01-25T04:43:49.709 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2023-01-25T04:43:49.709 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2023-01-25T04:43:49.709 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:43:51.057 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 23/25 2023-01-25T04:43:51.078 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 23/25 2023-01-25T04:43:51.078 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:43:51.280 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:43:51.280 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:43:51.747 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:43:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-01-25T04:43:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:All rules containing unresolvable specifiers will be skipped. 2023-01-25T04:43:51.748 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:43:51.799 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:43:51.799 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2023-01-25T04:43:51.799 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2023-01-25T04:43:51.799 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2023-01-25T04:43:51.800 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /run 2023-01-25T04:43:51.800 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2023-01-25T04:43:51.800 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2023-01-25T04:43:51.800 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2023-01-25T04:43:51.800 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2023-01-25T04:43:51.801 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2023-01-25T04:43:51.801 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:43:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 1/25 2023-01-25T04:43:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2/25 2023-01-25T04:43:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 3/25 2023-01-25T04:43:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:43:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 5/25 2023-01-25T04:43:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 6/25 2023-01-25T04:43:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:43:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8. 8/25 2023-01-25T04:43:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x8 9/25 2023-01-25T04:43:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 10/25 2023-01-25T04:43:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 11/25 2023-01-25T04:43:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 12/25 2023-01-25T04:43:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 13/25 2023-01-25T04:43:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-01-25T04:43:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-01-25T04:43:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-01-25T04:43:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-01-25T04:43:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 18/25 2023-01-25T04:43:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/25 2023-01-25T04:43:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 20/25 2023-01-25T04:43:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2023-01-25T04:43:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:43:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T04:43:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 24/25 2023-01-25T04:43:53.149 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 23/25 2023-01-25T04:43:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 23/25 2023-01-25T04:43:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:43:53.304 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:43:53.305 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:50 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:43:53.376 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:43:53.376 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:43:53.820 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:43:53.820 INFO:teuthology.orchestra.run.smithi154.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-01-25T04:43:53.820 INFO:teuthology.orchestra.run.smithi154.stdout:All rules containing unresolvable specifiers will be skipped. 2023-01-25T04:43:53.820 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:43:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 1/25 2023-01-25T04:43:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2/25 2023-01-25T04:43:53.972 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 3/25 2023-01-25T04:43:53.973 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:43:53.973 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 5/25 2023-01-25T04:43:53.973 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 6/25 2023-01-25T04:43:53.973 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:43:53.974 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8. 8/25 2023-01-25T04:43:53.974 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x8 9/25 2023-01-25T04:43:53.974 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 10/25 2023-01-25T04:43:53.974 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 11/25 2023-01-25T04:43:53.974 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 12/25 2023-01-25T04:43:53.975 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 13/25 2023-01-25T04:43:53.975 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-01-25T04:43:53.975 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-01-25T04:43:53.975 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-01-25T04:43:53.975 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-01-25T04:43:53.976 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 18/25 2023-01-25T04:43:53.976 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/25 2023-01-25T04:43:53.976 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 20/25 2023-01-25T04:43:53.976 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2023-01-25T04:43:53.976 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:43:53.977 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T04:43:53.977 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 24/25 2023-01-25T04:43:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:43:55.338 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:52 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:43:55.626 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:43:55.822 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:43:55.822 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2023-01-25T04:43:55.822 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.822 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.823 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:43:55.823 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.823 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.823 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.823 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.824 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T04:43:55.824 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.824 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T04:43:55.824 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T04:43:55.824 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.825 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T04:43:55.825 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.825 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T04:43:55.825 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T04:43:55.825 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.825 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.826 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.826 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T04:43:55.826 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.826 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.827 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:55.827 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T04:43:55.827 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:43:55.828 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:43:56.002 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-test 2023-01-25T04:43:56.348 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:43:57.140 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:43:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:43:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:43:57.847 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2023-01-25T04:43:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.847 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:43:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T04:43:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T04:43:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T04:43:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T04:43:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T04:43:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T04:43:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T04:43:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:43:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T04:43:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:43:57.852 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:43:58.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-test 2023-01-25T04:43:58.370 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:43:58.543 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:43:58.544 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2023-01-25T04:43:58.544 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:43:58.544 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2023-01-25T04:43:58.545 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:43:58.545 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 47 M 2023-01-25T04:43:58.545 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-25T04:43:58.545 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-01-25T04:43:58.546 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 137 k 2023-01-25T04:43:58.546 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-01-25T04:43:58.546 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-01-25T04:43:58.546 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-01-25T04:43:58.546 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:43:58.546 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:43:58.547 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2023-01-25T04:43:58.547 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2023-01-25T04:43:58.547 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:43:58.548 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 48 M 2023-01-25T04:43:58.548 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 218 M 2023-01-25T04:43:58.548 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:43:58.579 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 70 kB 00:00 2023-01-25T04:43:58.646 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-01-25T04:43:58.688 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-01-25T04:43:58.729 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-01-25T04:43:58.805 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): libcephsqlite-18.0.0-1959.gb0d25925.el8. 531 kB/s | 137 kB 00:00 2023-01-25T04:43:59.264 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:00.636 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:44:00.636 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================================ 2023-01-25T04:44:00.637 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:44:00.637 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================================ 2023-01-25T04:44:00.637 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:44:00.638 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 47 M 2023-01-25T04:44:00.638 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-01-25T04:44:00.638 INFO:teuthology.orchestra.run.smithi154.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-01-25T04:44:00.639 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 137 k 2023-01-25T04:44:00.639 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-01-25T04:44:00.639 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-01-25T04:44:00.640 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-01-25T04:44:00.640 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:00.640 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:44:00.641 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================================ 2023-01-25T04:44:00.641 INFO:teuthology.orchestra.run.smithi154.stdout:Install 6 Packages 2023-01-25T04:44:00.641 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:00.642 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 48 M 2023-01-25T04:44:00.642 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 218 M 2023-01-25T04:44:00.643 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:44:00.680 INFO:teuthology.orchestra.run.smithi154.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-01-25T04:44:00.739 INFO:teuthology.orchestra.run.smithi154.stdout:(2/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-01-25T04:44:00.764 INFO:teuthology.orchestra.run.smithi154.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.3 MB/s | 187 kB 00:00 2023-01-25T04:44:00.797 INFO:teuthology.orchestra.run.smithi154.stdout:(4/6): jq-1.6-3.el8.x86_64.rpm 5.9 MB/s | 202 kB 00:00 2023-01-25T04:44:01.106 INFO:teuthology.orchestra.run.smithi154.stdout:(5/6): libcephsqlite-18.0.0-1959.gb0d25925.el8. 294 kB/s | 137 kB 00:00 2023-01-25T04:44:01.488 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): ceph-test-18.0.0-1959.gb0d25925.el8.x86_ 16 MB/s | 47 MB 00:02 2023-01-25T04:44:01.490 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:01.490 INFO:teuthology.orchestra.run.smithi149.stdout:Total 16 MB/s | 48 MB 00:02 2023-01-25T04:44:01.527 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:44:01.549 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:44:01.549 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:44:01.807 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:44:01.811 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:44:02.245 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:44:02.392 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 1/6 2023-01-25T04:44:02.474 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 1/6 2023-01-25T04:44:02.666 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.6-3.el8.x86_64 2/6 2023-01-25T04:44:02.843 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/6 2023-01-25T04:44:02.995 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-01-25T04:44:03.184 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 5/6 2023-01-25T04:44:03.348 INFO:teuthology.orchestra.run.smithi154.stdout:(6/6): ceph-test-18.0.0-1959.gb0d25925.el8.x86_ 18 MB/s | 47 MB 00:02 2023-01-25T04:44:03.350 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:03.350 INFO:teuthology.orchestra.run.smithi154.stdout:Total 18 MB/s | 48 MB 00:02 2023-01-25T04:44:03.387 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:44:03.408 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:44:03.408 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:44:03.666 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:44:03.669 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:44:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:44:04.246 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 1/6 2023-01-25T04:44:04.309 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 1/6 2023-01-25T04:44:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : jq-1.6-3.el8.x86_64 2/6 2023-01-25T04:44:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/6 2023-01-25T04:44:04.850 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-01-25T04:44:05.038 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 5/6 2023-01-25T04:44:07.806 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 5/6 2023-01-25T04:44:08.055 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 6/6 2023-01-25T04:44:08.292 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 6/6 2023-01-25T04:44:08.292 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 1/6 2023-01-25T04:44:08.292 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 2/6 2023-01-25T04:44:08.292 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-01-25T04:44:08.293 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/6 2023-01-25T04:44:08.293 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-01-25T04:44:09.408 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.6-3.el8.x86_64 6/6 2023-01-25T04:44:09.408 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:06 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:09.665 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 5/6 2023-01-25T04:44:09.901 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 6/6 2023-01-25T04:44:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 6/6 2023-01-25T04:44:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 1/6 2023-01-25T04:44:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 2/6 2023-01-25T04:44:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-01-25T04:44:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/6 2023-01-25T04:44:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-01-25T04:44:11.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : jq-1.6-3.el8.x86_64 6/6 2023-01-25T04:44:11.184 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:08 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:11.739 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:44:11.922 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:11.922 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:44:11.922 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:11.922 INFO:teuthology.orchestra.run.smithi149.stdout: jq-1.6-3.el8.x86_64 2023-01-25T04:44:11.923 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:11.923 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T04:44:11.923 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T04:44:11.923 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T04:44:11.923 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:11.924 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:44:12.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph 2023-01-25T04:44:12.414 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:13.250 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:10 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:13.969 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:44:14.147 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:14.148 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:44:14.148 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:14.148 INFO:teuthology.orchestra.run.smithi154.stdout: jq-1.6-3.el8.x86_64 2023-01-25T04:44:14.148 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:14.149 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T04:44:14.149 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T04:44:14.149 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T04:44:14.149 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:14.149 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:44:14.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph 2023-01-25T04:44:14.627 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:14.628 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:44:14.631 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================= 2023-01-25T04:44:14.631 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:44:14.631 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================= 2023-01-25T04:44:14.632 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:44:14.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 6.4 k 2023-01-25T04:44:14.632 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-25T04:44:14.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 2.3 M 2023-01-25T04:44:14.632 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 1.5 M 2023-01-25T04:44:14.633 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 236 k 2023-01-25T04:44:14.633 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.9 M 2023-01-25T04:44:14.633 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 17 M 2023-01-25T04:44:14.633 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T04:44:14.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T04:44:14.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-01-25T04:44:14.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T04:44:14.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T04:44:14.634 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-01-25T04:44:14.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T04:44:14.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T04:44:14.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T04:44:14.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-01-25T04:44:14.635 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-01-25T04:44:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T04:44:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T04:44:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T04:44:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-01-25T04:44:14.636 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-01-25T04:44:14.637 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-01-25T04:44:14.637 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T04:44:14.637 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T04:44:14.637 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T04:44:14.637 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T04:44:14.638 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T04:44:14.638 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T04:44:14.638 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T04:44:14.638 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-01-25T04:44:14.638 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T04:44:14.638 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:14.639 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:44:14.639 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================= 2023-01-25T04:44:14.639 INFO:teuthology.orchestra.run.smithi149.stdout:Install 32 Packages 2023-01-25T04:44:14.639 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:14.640 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 28 M 2023-01-25T04:44:14.640 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 110 M 2023-01-25T04:44:14.640 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:44:14.806 INFO:teuthology.orchestra.run.smithi149.stdout:(1/32): ceph-18.0.0-1959.gb0d25925.el8.x86_64.r 38 kB/s | 6.4 kB 00:00 2023-01-25T04:44:14.982 INFO:teuthology.orchestra.run.smithi149.stdout:(2/32): ceph-mgr-18.0.0-1959.gb0d25925.el8.x86_ 4.4 MB/s | 1.5 MB 00:00 2023-01-25T04:44:15.032 INFO:teuthology.orchestra.run.smithi149.stdout:(3/32): ceph-mds-18.0.0-1959.gb0d25925.el8.x86_ 5.7 MB/s | 2.3 MB 00:00 2023-01-25T04:44:15.124 INFO:teuthology.orchestra.run.smithi149.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1959.gb0d2 2.5 MB/s | 236 kB 00:00 2023-01-25T04:44:15.257 INFO:teuthology.orchestra.run.smithi149.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 327 kB/s | 44 kB 00:00 2023-01-25T04:44:15.366 INFO:teuthology.orchestra.run.smithi149.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 1.7 MB/s | 185 kB 00:00 2023-01-25T04:44:15.425 INFO:teuthology.orchestra.run.smithi149.stdout:(7/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.9 MB/s | 173 kB 00:00 2023-01-25T04:44:15.448 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:12 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:15.500 INFO:teuthology.orchestra.run.smithi149.stdout:(8/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 5.0 MB/s | 384 kB 00:00 2023-01-25T04:44:15.575 INFO:teuthology.orchestra.run.smithi149.stdout:(9/32): ceph-mon-18.0.0-1959.gb0d25925.el8.x86_ 5.1 MB/s | 3.9 MB 00:00 2023-01-25T04:44:15.600 INFO:teuthology.orchestra.run.smithi149.stdout:(10/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-01-25T04:44:15.626 INFO:teuthology.orchestra.run.smithi149.stdout:(11/32): python3-jaraco-functools-2.0-4.el8.noa 351 kB/s | 18 kB 00:00 2023-01-25T04:44:15.676 INFO:teuthology.orchestra.run.smithi149.stdout:(12/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2023-01-25T04:44:15.734 INFO:teuthology.orchestra.run.smithi149.stdout:(13/32): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-01-25T04:44:15.760 INFO:teuthology.orchestra.run.smithi149.stdout:(14/32): python3-logutils-0.3.5-11.el8.noarch.r 306 kB/s | 49 kB 00:00 2023-01-25T04:44:15.927 INFO:teuthology.orchestra.run.smithi149.stdout:(15/32): ceph-osd-18.0.0-1959.gb0d25925.el8.x86 18 MB/s | 17 MB 00:00 2023-01-25T04:44:15.952 INFO:teuthology.orchestra.run.smithi149.stdout:(16/32): python3-portend-2.6-1.el8.noarch.rpm 72 kB/s | 16 kB 00:00 2023-01-25T04:44:15.977 INFO:teuthology.orchestra.run.smithi149.stdout:(17/32): python3-simplegeneric-0.8.1-17.el8.noa 86 kB/s | 19 kB 00:00 2023-01-25T04:44:16.027 INFO:teuthology.orchestra.run.smithi149.stdout:(18/32): python3-trustme-0.6.0-4.el8.noarch.rpm 553 kB/s | 27 kB 00:00 2023-01-25T04:44:16.053 INFO:teuthology.orchestra.run.smithi149.stdout:(19/32): python3-tempora-1.14.1-5.el8.noarch.rp 390 kB/s | 29 kB 00:00 2023-01-25T04:44:16.078 INFO:teuthology.orchestra.run.smithi149.stdout:(20/32): python3-singledispatch-3.4.0.3-18.el8. 159 kB/s | 24 kB 00:00 2023-01-25T04:44:16.136 INFO:teuthology.orchestra.run.smithi149.stdout:(21/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.9 MB/s | 251 kB 00:00 2023-01-25T04:44:16.162 INFO:teuthology.orchestra.run.smithi149.stdout:(22/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-01-25T04:44:16.203 INFO:teuthology.orchestra.run.smithi149.stdout:(23/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.3 MB/s | 241 kB 00:00 2023-01-25T04:44:16.229 INFO:teuthology.orchestra.run.smithi149.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 249 kB/s | 23 kB 00:00 2023-01-25T04:44:16.288 INFO:teuthology.orchestra.run.smithi149.stdout:(25/32): python3-pytz-2017.2-9.el8.noarch.rpm 431 kB/s | 54 kB 00:00 2023-01-25T04:44:16.313 INFO:teuthology.orchestra.run.smithi149.stdout:(26/32): python3-markupsafe-0.23-19.el8.x86_64. 354 kB/s | 39 kB 00:00 2023-01-25T04:44:16.338 INFO:teuthology.orchestra.run.smithi149.stdout:(27/32): python3-mako-1.0.6-13.el8.noarch.rpm 1.6 MB/s | 157 kB 00:00 2023-01-25T04:44:16.364 INFO:teuthology.orchestra.run.smithi149.stdout:(28/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 2.0 MB/s | 103 kB 00:00 2023-01-25T04:44:16.389 INFO:teuthology.orchestra.run.smithi149.stdout:(29/32): python3-werkzeug-0.12.2-4.el8.noarch.r 4.4 MB/s | 457 kB 00:00 2023-01-25T04:44:16.414 INFO:teuthology.orchestra.run.smithi149.stdout:(30/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-01-25T04:44:16.439 INFO:teuthology.orchestra.run.smithi149.stdout:(31/32): python3-pycparser-2.14-14.el8.noarch.r 1.4 MB/s | 109 kB 00:00 2023-01-25T04:44:16.481 INFO:teuthology.orchestra.run.smithi149.stdout:(32/32): python3-cryptography-3.2.1-5.el8.x86_6 5.9 MB/s | 559 kB 00:00 2023-01-25T04:44:16.483 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:16.483 INFO:teuthology.orchestra.run.smithi149.stdout:Total 15 MB/s | 28 MB 00:01 2023-01-25T04:44:16.566 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:44:16.603 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:44:16.603 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:44:16.807 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:44:16.810 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:44:16.849 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:44:16.853 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================= 2023-01-25T04:44:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:44:16.853 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================= 2023-01-25T04:44:16.853 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:44:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 6.4 k 2023-01-25T04:44:16.854 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-01-25T04:44:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 2.3 M 2023-01-25T04:44:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 1.5 M 2023-01-25T04:44:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 236 k 2023-01-25T04:44:16.855 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.9 M 2023-01-25T04:44:16.855 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 17 M 2023-01-25T04:44:16.855 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T04:44:16.855 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T04:44:16.856 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-01-25T04:44:16.856 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T04:44:16.856 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T04:44:16.856 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-01-25T04:44:16.856 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T04:44:16.857 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T04:44:16.857 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T04:44:16.857 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-01-25T04:44:16.857 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-01-25T04:44:16.857 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T04:44:16.858 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T04:44:16.858 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T04:44:16.858 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-01-25T04:44:16.858 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-01-25T04:44:16.858 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-01-25T04:44:16.859 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T04:44:16.859 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T04:44:16.859 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T04:44:16.859 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T04:44:16.859 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T04:44:16.860 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T04:44:16.860 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T04:44:16.860 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-01-25T04:44:16.860 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T04:44:16.861 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:16.861 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:44:16.861 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================= 2023-01-25T04:44:16.861 INFO:teuthology.orchestra.run.smithi154.stdout:Install 32 Packages 2023-01-25T04:44:16.861 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:16.862 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 28 M 2023-01-25T04:44:16.862 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 110 M 2023-01-25T04:44:16.863 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:44:16.992 INFO:teuthology.orchestra.run.smithi154.stdout:(1/32): ceph-18.0.0-1959.gb0d25925.el8.x86_64.r 48 kB/s | 6.4 kB 00:00 2023-01-25T04:44:17.183 INFO:teuthology.orchestra.run.smithi154.stdout:(2/32): ceph-mgr-18.0.0-1959.gb0d25925.el8.x86_ 4.7 MB/s | 1.5 MB 00:00 2023-01-25T04:44:17.234 INFO:teuthology.orchestra.run.smithi154.stdout:(3/32): ceph-mds-18.0.0-1959.gb0d25925.el8.x86_ 6.0 MB/s | 2.3 MB 00:00 2023-01-25T04:44:17.317 INFO:teuthology.orchestra.run.smithi154.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1959.gb0d2 2.8 MB/s | 236 kB 00:00 2023-01-25T04:44:17.459 INFO:teuthology.orchestra.run.smithi154.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 308 kB/s | 44 kB 00:00 2023-01-25T04:44:17.568 INFO:teuthology.orchestra.run.smithi154.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 1.7 MB/s | 185 kB 00:00 2023-01-25T04:44:17.618 INFO:teuthology.orchestra.run.smithi154.stdout:(7/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 3.4 MB/s | 173 kB 00:00 2023-01-25T04:44:17.727 INFO:teuthology.orchestra.run.smithi154.stdout:(8/32): ceph-mon-18.0.0-1959.gb0d25925.el8.x86_ 5.3 MB/s | 3.9 MB 00:00 2023-01-25T04:44:17.752 INFO:teuthology.orchestra.run.smithi154.stdout:(9/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 2.8 MB/s | 384 kB 00:00 2023-01-25T04:44:17.802 INFO:teuthology.orchestra.run.smithi154.stdout:(10/32): python3-jaraco-functools-2.0-4.el8.noa 352 kB/s | 18 kB 00:00 2023-01-25T04:44:17.828 INFO:teuthology.orchestra.run.smithi154.stdout:(11/32): python3-jaraco-6.2-6.el8.noarch.rpm 110 kB/s | 11 kB 00:00 2023-01-25T04:44:17.861 INFO:teuthology.orchestra.run.smithi154.stdout:(12/32): python3-logutils-0.3.5-11.el8.noarch.r 831 kB/s | 49 kB 00:00 2023-01-25T04:44:17.885 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:44:17.903 INFO:teuthology.orchestra.run.smithi154.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 781 kB/s | 59 kB 00:00 2023-01-25T04:44:18.077 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T04:44:18.079 INFO:teuthology.orchestra.run.smithi154.stdout:(14/32): ceph-osd-18.0.0-1959.gb0d25925.el8.x86 19 MB/s | 17 MB 00:00 2023-01-25T04:44:18.095 INFO:teuthology.orchestra.run.smithi154.stdout:(15/32): python3-portend-2.6-1.el8.noarch.rpm 81 kB/s | 16 kB 00:00 2023-01-25T04:44:18.121 INFO:teuthology.orchestra.run.smithi154.stdout:(16/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-01-25T04:44:18.146 INFO:teuthology.orchestra.run.smithi154.stdout:(17/32): python3-singledispatch-3.4.0.3-18.el8. 474 kB/s | 24 kB 00:00 2023-01-25T04:44:18.171 INFO:teuthology.orchestra.run.smithi154.stdout:(18/32): python3-tempora-1.14.1-5.el8.noarch.rp 582 kB/s | 29 kB 00:00 2023-01-25T04:44:18.196 INFO:teuthology.orchestra.run.smithi154.stdout:(19/32): python3-trustme-0.6.0-4.el8.noarch.rpm 550 kB/s | 27 kB 00:00 2023-01-25T04:44:18.214 INFO:teuthology.orchestra.run.smithi154.stdout:(20/32): python3-simplegeneric-0.8.1-17.el8.noa 139 kB/s | 19 kB 00:00 2023-01-25T04:44:18.264 INFO:teuthology.orchestra.run.smithi154.stdout:(21/32): python3-waitress-1.2.1-2.el8.1.noarch. 2.5 MB/s | 241 kB 00:00 2023-01-25T04:44:18.298 INFO:teuthology.orchestra.run.smithi154.stdout:(22/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2023-01-25T04:44:18.314 INFO:teuthology.orchestra.run.smithi154.stdout:(23/32): python3-zc-lockfile-2.0-2.el8.noarch.r 458 kB/s | 23 kB 00:00 2023-01-25T04:44:18.318 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T04:44:18.340 INFO:teuthology.orchestra.run.smithi154.stdout:(24/32): python3-webtest-2.0.33-1.el8.noarch.rp 678 kB/s | 85 kB 00:00 2023-01-25T04:44:18.373 INFO:teuthology.orchestra.run.smithi154.stdout:(25/32): python3-pytz-2017.2-9.el8.noarch.rpm 718 kB/s | 54 kB 00:00 2023-01-25T04:44:18.399 INFO:teuthology.orchestra.run.smithi154.stdout:(26/32): python3-markupsafe-0.23-19.el8.x86_64. 462 kB/s | 39 kB 00:00 2023-01-25T04:44:18.424 INFO:teuthology.orchestra.run.smithi154.stdout:(27/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.1 MB/s | 157 kB 00:00 2023-01-25T04:44:18.449 INFO:teuthology.orchestra.run.smithi154.stdout:(28/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 2.0 MB/s | 103 kB 00:00 2023-01-25T04:44:18.474 INFO:teuthology.orchestra.run.smithi154.stdout:(29/32): python3-werkzeug-0.12.2-4.el8.noarch.r 4.7 MB/s | 457 kB 00:00 2023-01-25T04:44:18.500 INFO:teuthology.orchestra.run.smithi154.stdout:(30/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-01-25T04:44:18.517 INFO:teuthology.orchestra.run.smithi154.stdout:(31/32): python3-pycparser-2.14-14.el8.noarch.r 1.6 MB/s | 109 kB 00:00 2023-01-25T04:44:18.524 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 3/32 2023-01-25T04:44:18.580 INFO:teuthology.orchestra.run.smithi154.stdout:(32/32): python3-cryptography-3.2.1-5.el8.x86_6 5.2 MB/s | 559 kB 00:00 2023-01-25T04:44:18.581 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:18.583 INFO:teuthology.orchestra.run.smithi154.stdout:Total 16 MB/s | 28 MB 00:01 2023-01-25T04:44:18.669 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:44:18.705 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:44:18.706 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:44:18.894 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 4/32 2023-01-25T04:44:18.909 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:44:18.913 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:44:19.151 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 5/32 2023-01-25T04:44:19.330 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 6/32 2023-01-25T04:44:19.763 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 7/32 2023-01-25T04:44:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:44:20.060 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 8/32 2023-01-25T04:44:20.175 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T04:44:20.268 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 9/32 2023-01-25T04:44:20.406 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T04:44:20.485 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 10/32 2023-01-25T04:44:20.612 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 3/32 2023-01-25T04:44:20.692 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 11/32 2023-01-25T04:44:20.889 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 12/32 2023-01-25T04:44:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 4/32 2023-01-25T04:44:21.099 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2023-01-25T04:44:21.262 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 14/32 2023-01-25T04:44:21.263 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 5/32 2023-01-25T04:44:21.426 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 6/32 2023-01-25T04:44:21.435 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2023-01-25T04:44:21.592 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2023-01-25T04:44:21.663 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 7/32 2023-01-25T04:44:21.742 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2023-01-25T04:44:21.870 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2023-01-25T04:44:22.012 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 8/32 2023-01-25T04:44:22.093 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2023-01-25T04:44:22.239 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 9/32 2023-01-25T04:44:22.300 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2023-01-25T04:44:22.462 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 10/32 2023-01-25T04:44:22.469 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T04:44:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 11/32 2023-01-25T04:44:22.735 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T04:44:22.842 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 12/32 2023-01-25T04:44:22.969 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T04:44:23.063 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2023-01-25T04:44:23.148 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2023-01-25T04:44:23.233 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 14/32 2023-01-25T04:44:23.380 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2023-01-25T04:44:23.449 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2023-01-25T04:44:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2023-01-25T04:44:23.712 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2023-01-25T04:44:23.758 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T04:44:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2023-01-25T04:44:24.092 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8. 27/32 2023-01-25T04:44:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2023-01-25T04:44:24.227 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 28/32 2023-01-25T04:44:24.338 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2023-01-25T04:44:24.524 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T04:44:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T04:44:25.065 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T04:44:25.269 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2023-01-25T04:44:25.626 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2023-01-25T04:44:25.722 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 28/32 2023-01-25T04:44:25.877 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 29/32 2023-01-25T04:44:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T04:44:26.261 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 29/32 2023-01-25T04:44:26.262 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8. 27/32 2023-01-25T04:44:26.405 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 30/32 2023-01-25T04:44:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 28/32 2023-01-25T04:44:26.620 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 30/32 2023-01-25T04:44:26.772 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 31/32 2023-01-25T04:44:26.790 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 31/32 2023-01-25T04:44:26.895 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 32/32 2023-01-25T04:44:27.257 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 32/32 2023-01-25T04:44:27.257 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 1/32 2023-01-25T04:44:27.257 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 2/32 2023-01-25T04:44:27.257 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 3/32 2023-01-25T04:44:27.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 4/32 2023-01-25T04:44:27.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 5/32 2023-01-25T04:44:27.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8. 6/32 2023-01-25T04:44:27.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2023-01-25T04:44:27.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2023-01-25T04:44:27.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2023-01-25T04:44:27.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2023-01-25T04:44:27.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2023-01-25T04:44:27.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2023-01-25T04:44:27.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2023-01-25T04:44:27.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2023-01-25T04:44:27.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2023-01-25T04:44:27.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2023-01-25T04:44:27.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2023-01-25T04:44:27.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2023-01-25T04:44:27.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2023-01-25T04:44:27.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2023-01-25T04:44:27.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 21/32 2023-01-25T04:44:27.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2023-01-25T04:44:27.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2023-01-25T04:44:27.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2023-01-25T04:44:27.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 25/32 2023-01-25T04:44:27.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/32 2023-01-25T04:44:27.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/32 2023-01-25T04:44:27.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2023-01-25T04:44:27.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 29/32 2023-01-25T04:44:27.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 30/32 2023-01-25T04:44:27.264 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 31/32 2023-01-25T04:44:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 28/32 2023-01-25T04:44:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 29/32 2023-01-25T04:44:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 29/32 2023-01-25T04:44:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 30/32 2023-01-25T04:44:28.735 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 32/32 2023-01-25T04:44:28.735 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:25 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:28.881 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 30/32 2023-01-25T04:44:29.059 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 31/32 2023-01-25T04:44:29.077 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 31/32 2023-01-25T04:44:29.198 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 32/32 2023-01-25T04:44:29.552 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 32/32 2023-01-25T04:44:29.553 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 1/32 2023-01-25T04:44:29.553 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 2/32 2023-01-25T04:44:29.553 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 3/32 2023-01-25T04:44:29.553 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 4/32 2023-01-25T04:44:29.553 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 5/32 2023-01-25T04:44:29.554 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8. 6/32 2023-01-25T04:44:29.554 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2023-01-25T04:44:29.554 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2023-01-25T04:44:29.554 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2023-01-25T04:44:29.554 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2023-01-25T04:44:29.554 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2023-01-25T04:44:29.555 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2023-01-25T04:44:29.555 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2023-01-25T04:44:29.555 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2023-01-25T04:44:29.555 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2023-01-25T04:44:29.555 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2023-01-25T04:44:29.556 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2023-01-25T04:44:29.556 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2023-01-25T04:44:29.556 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2023-01-25T04:44:29.556 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2023-01-25T04:44:29.556 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 21/32 2023-01-25T04:44:29.557 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2023-01-25T04:44:29.557 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2023-01-25T04:44:29.557 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2023-01-25T04:44:29.557 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 25/32 2023-01-25T04:44:29.557 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/32 2023-01-25T04:44:29.557 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/32 2023-01-25T04:44:29.558 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2023-01-25T04:44:29.558 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 29/32 2023-01-25T04:44:29.558 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 30/32 2023-01-25T04:44:29.558 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 31/32 2023-01-25T04:44:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 32/32 2023-01-25T04:44:31.048 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:28 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:31.089 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:44:31.275 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:31.275 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:44:31.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:31.275 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:31.276 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:31.276 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:44:31.276 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:31.276 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:31.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T04:44:31.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T04:44:31.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T04:44:31.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T04:44:31.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T04:44:31.277 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T04:44:31.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T04:44:31.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T04:44:31.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T04:44:31.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T04:44:31.278 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T04:44:31.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T04:44:31.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T04:44:31.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T04:44:31.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T04:44:31.279 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T04:44:31.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T04:44:31.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T04:44:31.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T04:44:31.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T04:44:31.280 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T04:44:31.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T04:44:31.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T04:44:31.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T04:44:31.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T04:44:31.281 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T04:44:31.282 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:31.282 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:44:31.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-base 2023-01-25T04:44:31.799 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:32.579 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:29 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:33.493 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:44:33.676 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:33.676 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:44:33.676 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:33.677 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:33.677 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:33.677 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:44:33.677 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:33.678 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:33.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T04:44:33.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T04:44:33.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T04:44:33.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T04:44:33.679 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T04:44:33.679 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T04:44:33.679 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T04:44:33.679 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T04:44:33.679 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T04:44:33.680 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T04:44:33.680 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T04:44:33.680 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T04:44:33.680 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T04:44:33.680 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T04:44:33.681 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T04:44:33.681 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T04:44:33.681 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T04:44:33.681 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T04:44:33.681 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T04:44:33.682 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T04:44:33.682 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T04:44:33.682 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T04:44:33.682 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T04:44:33.682 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T04:44:33.683 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T04:44:33.683 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T04:44:33.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:33.683 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:44:33.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-base 2023-01-25T04:44:33.875 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:44:33.981 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:44:33.983 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:44:33.984 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:44:34.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install cephadm 2023-01-25T04:44:34.183 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:34.459 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:34.992 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:31 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:35.249 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:36.275 INFO:teuthology.orchestra.run.smithi154.stdout:Package ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:44:36.381 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:44:36.382 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:44:36.383 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:44:36.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install cephadm 2023-01-25T04:44:36.719 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:44:36.720 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:44:36.720 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:44:36.720 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:44:36.721 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:44:36.721 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 82 k 2023-01-25T04:44:36.721 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:36.721 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:44:36.721 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:44:36.722 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2023-01-25T04:44:36.722 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:36.722 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 82 k 2023-01-25T04:44:36.723 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 374 k 2023-01-25T04:44:36.723 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:44:36.845 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:37.176 INFO:teuthology.orchestra.run.smithi149.stdout:cephadm-18.0.0-1959.gb0d25925.el8.noarch.rpm 181 kB/s | 82 kB 00:00 2023-01-25T04:44:37.176 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:37.177 INFO:teuthology.orchestra.run.smithi149.stdout:Total 180 kB/s | 82 kB 00:00 2023-01-25T04:44:37.177 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:44:37.186 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:44:37.187 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:44:37.189 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:44:37.193 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:44:37.630 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:34 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:37.682 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:44:39.097 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:44:39.098 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:44:39.098 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:44:39.098 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:44:39.098 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:44:39.099 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 82 k 2023-01-25T04:44:39.099 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:39.099 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:44:39.099 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:44:39.099 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-01-25T04:44:39.100 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:39.100 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 82 k 2023-01-25T04:44:39.100 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 374 k 2023-01-25T04:44:39.100 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:44:39.274 INFO:teuthology.orchestra.run.smithi154.stdout:cephadm-18.0.0-1959.gb0d25925.el8.noarch.rpm 469 kB/s | 82 kB 00:00 2023-01-25T04:44:39.275 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:39.275 INFO:teuthology.orchestra.run.smithi154.stdout:Total 466 kB/s | 82 kB 00:00 2023-01-25T04:44:39.276 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:44:39.283 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:44:39.283 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:44:39.285 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:44:39.289 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:44:39.331 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:44:39.332 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:44:39.486 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:44:39.660 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:44:40.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:44:40.718 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:37 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:40.894 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:44:41.053 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:44:41.219 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:44:42.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:44:42.254 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:39 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:43.168 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:44:43.351 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:43.352 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:44:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:44:43.352 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:43.352 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:44:43.532 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T04:44:43.886 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:44.694 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:41 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:44.739 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:44:44.919 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:44.919 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:44:44.919 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:44:44.919 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:44.919 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:44:45.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T04:44:45.421 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:46.105 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:44:46.106 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:44:46.106 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2023-01-25T04:44:46.106 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:44:46.107 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:44:46.107 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 166 k 2023-01-25T04:44:46.107 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:46.107 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:44:46.107 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:44:46.108 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2023-01-25T04:44:46.108 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:46.108 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 166 k 2023-01-25T04:44:46.109 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 503 k 2023-01-25T04:44:46.109 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:44:46.205 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:43 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:46.300 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-immutable-object-cache-18.0.0-1959.gb0d259 859 kB/s | 166 kB 00:00 2023-01-25T04:44:46.300 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:46.301 INFO:teuthology.orchestra.run.smithi149.stdout:Total 853 kB/s | 166 kB 00:00 2023-01-25T04:44:46.301 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:44:46.312 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:44:46.312 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:44:46.364 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:44:46.368 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:44:46.496 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:44:46.635 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:44:47.007 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:44:47.599 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:44:47.600 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:44:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repo Size 2023-01-25T04:44:47.601 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:44:47.601 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:44:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 166 k 2023-01-25T04:44:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:47.601 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:44:47.602 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:44:47.602 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-01-25T04:44:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:47.602 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 166 k 2023-01-25T04:44:47.602 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 503 k 2023-01-25T04:44:47.603 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:44:47.814 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-immutable-object-cache-18.0.0-1959.gb0d259 779 kB/s | 166 kB 00:00 2023-01-25T04:44:47.814 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:47.815 INFO:teuthology.orchestra.run.smithi154.stdout:Total 774 kB/s | 166 kB 00:00 2023-01-25T04:44:47.815 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:44:47.826 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:44:47.826 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:44:47.877 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:44:47.881 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:44:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:44:48.068 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:44:48.068 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:45 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:48.156 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:44:48.506 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:44:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:44:49.532 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:46 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:50.756 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:44:50.938 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:50.938 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:44:50.938 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:50.938 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:50.939 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:44:51.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr 2023-01-25T04:44:51.438 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:52.102 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:44:52.286 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:52.286 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:44:52.286 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:44:52.286 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:52.287 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:44:52.299 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:49 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:52.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr 2023-01-25T04:44:52.764 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:53.526 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:50 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:53.596 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:44:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:44:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:44:53.709 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:44:53.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T04:44:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:54.805 INFO:teuthology.orchestra.run.smithi154.stdout:Package ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:44:54.912 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:44:54.913 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:44:54.913 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:44:55.102 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:52 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:55.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T04:44:55.493 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:44:56.376 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:53 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:44:56.501 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:44:56.502 INFO:teuthology.orchestra.run.smithi149.stdout:=================================================================================================== 2023-01-25T04:44:56.502 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:44:56.502 INFO:teuthology.orchestra.run.smithi149.stdout:=================================================================================================== 2023-01-25T04:44:56.503 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:44:56.503 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 1.7 M 2023-01-25T04:44:56.503 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-25T04:44:56.503 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 23 k 2023-01-25T04:44:56.504 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 15 k 2023-01-25T04:44:56.504 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-25T04:44:56.504 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T04:44:56.504 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T04:44:56.504 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:56.505 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:44:56.505 INFO:teuthology.orchestra.run.smithi149.stdout:=================================================================================================== 2023-01-25T04:44:56.505 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2023-01-25T04:44:56.505 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:44:56.506 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 2.0 M 2023-01-25T04:44:56.506 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 8.2 M 2023-01-25T04:44:56.506 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:44:56.888 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): ceph-prometheus-alerts-18.0.0-1959.gb0d2 38 kB/s | 15 kB 00:00 2023-01-25T04:44:56.913 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): ceph-grafana-dashboards-18.0.0-1959.gb0d 56 kB/s | 23 kB 00:00 2023-01-25T04:44:57.013 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 268 kB/s | 34 kB 00:00 2023-01-25T04:44:57.064 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): ceph-mgr-dashboard-18.0.0-1959.gb0d25925 3.1 MB/s | 1.7 MB 00:00 2023-01-25T04:44:57.106 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2023-01-25T04:44:57.131 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 905 kB/s | 196 kB 00:00 2023-01-25T04:44:57.133 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:57.133 INFO:teuthology.orchestra.run.smithi149.stdout:Total 3.2 MB/s | 2.0 MB 00:00 2023-01-25T04:44:57.144 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:44:57.153 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:44:57.153 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:44:57.210 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:44:57.214 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:44:57.477 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:44:57.634 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-01-25T04:44:57.749 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:44:57.750 INFO:teuthology.orchestra.run.smithi154.stdout:=================================================================================================== 2023-01-25T04:44:57.751 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:44:57.751 INFO:teuthology.orchestra.run.smithi154.stdout:=================================================================================================== 2023-01-25T04:44:57.751 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:44:57.751 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 1.7 M 2023-01-25T04:44:57.751 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-01-25T04:44:57.752 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 23 k 2023-01-25T04:44:57.752 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 15 k 2023-01-25T04:44:57.752 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-25T04:44:57.753 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T04:44:57.753 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T04:44:57.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:57.753 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:44:57.754 INFO:teuthology.orchestra.run.smithi154.stdout:=================================================================================================== 2023-01-25T04:44:57.754 INFO:teuthology.orchestra.run.smithi154.stdout:Install 6 Packages 2023-01-25T04:44:57.754 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:44:57.755 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 2.0 M 2023-01-25T04:44:57.755 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 8.2 M 2023-01-25T04:44:57.755 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:44:57.806 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-01-25T04:44:57.902 INFO:teuthology.orchestra.run.smithi154.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1959.gb0d 154 kB/s | 23 kB 00:00 2023-01-25T04:44:57.919 INFO:teuthology.orchestra.run.smithi154.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1959.gb0d2 88 kB/s | 15 kB 00:00 2023-01-25T04:44:57.969 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-01-25T04:44:58.019 INFO:teuthology.orchestra.run.smithi154.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 288 kB/s | 34 kB 00:00 2023-01-25T04:44:58.061 INFO:teuthology.orchestra.run.smithi154.stdout:(4/6): ceph-mgr-dashboard-18.0.0-1959.gb0d25925 5.6 MB/s | 1.7 MB 00:00 2023-01-25T04:44:58.095 INFO:teuthology.orchestra.run.smithi154.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.1 MB/s | 196 kB 00:00 2023-01-25T04:44:58.120 INFO:teuthology.orchestra.run.smithi154.stdout:(6/6): python3-jwt-1.6.1-2.el8.noarch.rpm 424 kB/s | 43 kB 00:00 2023-01-25T04:44:58.121 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:44:58.122 INFO:teuthology.orchestra.run.smithi154.stdout:Total 5.5 MB/s | 2.0 MB 00:00 2023-01-25T04:44:58.123 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.n 4/6 2023-01-25T04:44:58.133 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:44:58.142 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:44:58.143 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:44:58.198 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:44:58.202 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:44:58.444 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:44:58.446 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8. 5/6 2023-01-25T04:44:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-01-25T04:44:58.718 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 6/6 2023-01-25T04:44:58.834 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-01-25T04:44:58.960 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 6/6 2023-01-25T04:44:58.960 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8. 1/6 2023-01-25T04:44:58.960 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 2/6 2023-01-25T04:44:58.960 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.n 3/6 2023-01-25T04:44:58.961 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-01-25T04:44:58.961 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-01-25T04:44:59.040 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-01-25T04:44:59.193 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.n 4/6 2023-01-25T04:44:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8. 5/6 2023-01-25T04:44:59.774 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 6/6 2023-01-25T04:45:00.007 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 6/6 2023-01-25T04:45:00.007 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8. 1/6 2023-01-25T04:45:00.007 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 2/6 2023-01-25T04:45:00.008 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.n 3/6 2023-01-25T04:45:00.008 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-01-25T04:45:00.008 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-01-25T04:45:00.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-01-25T04:45:00.717 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:57 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-01-25T04:45:01.050 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:58 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:03.989 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:45:04.175 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:04.175 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:45:04.175 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:04.175 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:04.176 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:04.176 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T04:45:04.176 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T04:45:04.176 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T04:45:04.176 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:04.177 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:45:04.194 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:45:04.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T04:45:04.375 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:04.375 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:45:04.376 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:04.376 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:04.376 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:04.376 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T04:45:04.377 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T04:45:04.377 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T04:45:04.377 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:04.377 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:45:04.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T04:45:04.691 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:04.861 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:05.478 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:02 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:05.658 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:02 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:06.944 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:45:06.946 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================================= 2023-01-25T04:45:06.946 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:45:06.946 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================================= 2023-01-25T04:45:06.946 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:45:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 7.4 M 2023-01-25T04:45:06.947 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-25T04:45:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-01-25T04:45:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-01-25T04:45:06.947 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-01-25T04:45:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-01-25T04:45:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-01-25T04:45:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-01-25T04:45:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-01-25T04:45:06.948 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:06.949 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:45:06.949 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================================= 2023-01-25T04:45:06.949 INFO:teuthology.orchestra.run.smithi149.stdout:Install 8 Packages 2023-01-25T04:45:06.949 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:06.950 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 35 M 2023-01-25T04:45:06.950 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 210 M 2023-01-25T04:45:06.950 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:45:07.046 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:45:07.047 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================================= 2023-01-25T04:45:07.047 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:45:07.047 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================================= 2023-01-25T04:45:07.048 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:45:07.048 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 7.4 M 2023-01-25T04:45:07.048 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-01-25T04:45:07.048 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-01-25T04:45:07.049 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-01-25T04:45:07.049 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-01-25T04:45:07.049 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-01-25T04:45:07.049 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-01-25T04:45:07.049 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-01-25T04:45:07.050 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-01-25T04:45:07.050 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:07.050 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:45:07.050 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================================= 2023-01-25T04:45:07.050 INFO:teuthology.orchestra.run.smithi154.stdout:Install 8 Packages 2023-01-25T04:45:07.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:07.051 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 35 M 2023-01-25T04:45:07.052 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 210 M 2023-01-25T04:45:07.052 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:45:07.104 INFO:teuthology.orchestra.run.smithi149.stdout:(1/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 24 MB/s | 3.7 MB 00:00 2023-01-25T04:45:07.145 INFO:teuthology.orchestra.run.smithi149.stdout:(2/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 5.3 MB/s | 225 kB 00:00 2023-01-25T04:45:07.193 INFO:teuthology.orchestra.run.smithi154.stdout:(1/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 26 MB/s | 3.7 MB 00:00 2023-01-25T04:45:07.227 INFO:teuthology.orchestra.run.smithi154.stdout:(2/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-25T04:45:07.304 INFO:teuthology.orchestra.run.smithi149.stdout:(3/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 31 MB/s | 4.9 MB 00:00 2023-01-25T04:45:07.377 INFO:teuthology.orchestra.run.smithi154.stdout:(3/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 32 MB/s | 4.9 MB 00:00 2023-01-25T04:45:07.479 INFO:teuthology.orchestra.run.smithi149.stdout:(4/8): python3-scipy-1.0.0-21.module+el8.5.0+10 26 MB/s | 14 MB 00:00 2023-01-25T04:45:07.519 INFO:teuthology.orchestra.run.smithi154.stdout:(4/8): python3-scipy-1.0.0-21.module+el8.5.0+10 29 MB/s | 14 MB 00:00 2023-01-25T04:45:07.570 INFO:teuthology.orchestra.run.smithi154.stdout:(5/8): libgfortran-8.5.0-10.1.el8_6.x86_64.rpm 13 MB/s | 644 kB 00:00 2023-01-25T04:45:07.596 INFO:teuthology.orchestra.run.smithi149.stdout:(5/8): ceph-mgr-diskprediction-local-18.0.0-195 11 MB/s | 7.4 MB 00:00 2023-01-25T04:45:07.611 INFO:teuthology.orchestra.run.smithi154.stdout:(6/8): libquadmath-8.5.0-10.1.el8_6.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2023-01-25T04:45:07.630 INFO:teuthology.orchestra.run.smithi149.stdout:(6/8): libgfortran-8.5.0-10.1.el8_6.x86_64.rpm 4.2 MB/s | 644 kB 00:00 2023-01-25T04:45:07.672 INFO:teuthology.orchestra.run.smithi149.stdout:(7/8): libquadmath-8.5.0-10.1.el8_6.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2023-01-25T04:45:07.686 INFO:teuthology.orchestra.run.smithi154.stdout:(7/8): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-01-25T04:45:07.739 INFO:teuthology.orchestra.run.smithi149.stdout:(8/8): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-01-25T04:45:07.740 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:07.740 INFO:teuthology.orchestra.run.smithi149.stdout:Total 45 MB/s | 35 MB 00:00 2023-01-25T04:45:07.945 INFO:teuthology.orchestra.run.smithi154.stdout:(8/8): ceph-mgr-diskprediction-local-18.0.0-195 8.3 MB/s | 7.4 MB 00:00 2023-01-25T04:45:07.946 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:07.947 INFO:teuthology.orchestra.run.smithi154.stdout:Total 39 MB/s | 35 MB 00:00 2023-01-25T04:45:07.978 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:45:07.996 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:45:07.997 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:45:08.185 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:45:08.203 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:45:08.203 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:45:08.290 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:45:08.294 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:45:08.497 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:45:08.501 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:45:08.835 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:45:08.965 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-01-25T04:45:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:45:09.113 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-01-25T04:45:09.218 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-01-25T04:45:09.240 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T04:45:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-01-25T04:45:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T04:45:09.855 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T04:45:10.032 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-01-25T04:45:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-01-25T04:45:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-01-25T04:45:10.658 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-01-25T04:45:10.823 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.15-3.el8.x86_64 4/8 2023-01-25T04:45:10.837 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-01-25T04:45:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.15-3.el8.x86_64 4/8 2023-01-25T04:45:11.511 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 4/8 2023-01-25T04:45:11.691 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 4/8 2023-01-25T04:45:11.809 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T04:45:11.998 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:45:12.360 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T04:45:12.561 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:45:13.747 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:45:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:45:14.998 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 7/8 2023-01-25T04:45:15.147 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 8/8 2023-01-25T04:45:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 8/8 2023-01-25T04:45:15.427 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 1/8 2023-01-25T04:45:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 2/8 2023-01-25T04:45:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 3/8 2023-01-25T04:45:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T04:45:15.428 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 5/8 2023-01-25T04:45:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 6/8 2023-01-25T04:45:15.429 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 7/8 2023-01-25T04:45:15.583 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 7/8 2023-01-25T04:45:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 8/8 2023-01-25T04:45:16.014 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 8/8 2023-01-25T04:45:16.014 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 1/8 2023-01-25T04:45:16.015 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 2/8 2023-01-25T04:45:16.016 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 3/8 2023-01-25T04:45:16.016 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T04:45:16.016 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 5/8 2023-01-25T04:45:16.016 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 6/8 2023-01-25T04:45:16.016 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 7/8 2023-01-25T04:45:16.504 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 8/8 2023-01-25T04:45:16.504 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:13 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:17.051 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 8/8 2023-01-25T04:45:17.051 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:14 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:18.983 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:45:19.171 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:19.171 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:45:19.171 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:19.171 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-01-25T04:45:19.172 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-01-25T04:45:19.172 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.15-3.el8.x86_64 2023-01-25T04:45:19.172 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-01-25T04:45:19.172 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T04:45:19.172 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T04:45:19.173 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-01-25T04:45:19.173 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:19.173 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:45:19.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-rook 2023-01-25T04:45:19.606 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:45:19.678 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:19.787 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:19.788 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:45:19.788 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:19.788 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-01-25T04:45:19.788 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-01-25T04:45:19.788 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.15-3.el8.x86_64 2023-01-25T04:45:19.789 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-01-25T04:45:19.789 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T04:45:19.789 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T04:45:19.789 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-01-25T04:45:19.789 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:19.790 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:45:19.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr-rook 2023-01-25T04:45:20.288 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:20.519 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:17 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:21.079 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:18 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:21.905 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:45:21.907 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================== 2023-01-25T04:45:21.907 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:45:21.907 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================== 2023-01-25T04:45:21.908 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:45:21.908 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 47 k 2023-01-25T04:45:21.908 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-25T04:45:21.908 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T04:45:21.908 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T04:45:21.909 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T04:45:21.909 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-01-25T04:45:21.909 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-01-25T04:45:21.909 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T04:45:21.909 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-01-25T04:45:21.910 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-01-25T04:45:21.910 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-01-25T04:45:21.910 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-25T04:45:21.910 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T04:45:21.910 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T04:45:21.911 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:21.911 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:45:21.911 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================================== 2023-01-25T04:45:21.911 INFO:teuthology.orchestra.run.smithi149.stdout:Install 13 Packages 2023-01-25T04:45:21.911 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:21.912 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 1.9 M 2023-01-25T04:45:21.912 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 25 M 2023-01-25T04:45:21.912 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:45:22.020 INFO:teuthology.orchestra.run.smithi149.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 150 kB/s | 16 kB 00:00 2023-01-25T04:45:22.045 INFO:teuthology.orchestra.run.smithi149.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 245 kB/s | 33 kB 00:00 2023-01-25T04:45:22.078 INFO:teuthology.orchestra.run.smithi149.stdout:(3/13): ceph-mgr-rook-18.0.0-1959.gb0d25925.el8 282 kB/s | 47 kB 00:00 2023-01-25T04:45:22.104 INFO:teuthology.orchestra.run.smithi149.stdout:(4/13): python3-google-auth-1.1.1-10.el8.noarch 968 kB/s | 81 kB 00:00 2023-01-25T04:45:22.154 INFO:teuthology.orchestra.run.smithi149.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 1.2 MB/s | 61 kB 00:00 2023-01-25T04:45:22.204 INFO:teuthology.orchestra.run.smithi149.stdout:(6/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-25T04:45:22.229 INFO:teuthology.orchestra.run.smithi149.stdout:(7/13): python3-rsa-4.8-1.el8.noarch.rpm 408 kB/s | 61 kB 00:00 2023-01-25T04:45:22.255 INFO:teuthology.orchestra.run.smithi149.stdout:(8/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 527 kB/s | 27 kB 00:00 2023-01-25T04:45:22.297 INFO:teuthology.orchestra.run.smithi149.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 4.6 MB/s | 1.2 MB 00:00 2023-01-25T04:45:22.313 INFO:teuthology.orchestra.run.smithi149.stdout:(10/13): python3-jsonpointer-1.10-11.el8.noarch 376 kB/s | 20 kB 00:00 2023-01-25T04:45:22.347 INFO:teuthology.orchestra.run.smithi149.stdout:(11/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-01-25T04:45:22.364 INFO:teuthology.orchestra.run.smithi149.stdout:(12/13): python3-requests-oauthlib-1.0.0-1.el8. 949 kB/s | 43 kB 00:00 2023-01-25T04:45:22.390 INFO:teuthology.orchestra.run.smithi149.stdout:(13/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 1.6 MB/s | 155 kB 00:00 2023-01-25T04:45:22.390 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:22.390 INFO:teuthology.orchestra.run.smithi149.stdout:Total 4.0 MB/s | 1.9 MB 00:00 2023-01-25T04:45:22.448 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:45:22.463 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:45:22.464 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:45:22.466 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:45:22.468 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================== 2023-01-25T04:45:22.468 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:45:22.468 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================== 2023-01-25T04:45:22.469 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:45:22.469 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 47 k 2023-01-25T04:45:22.469 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-01-25T04:45:22.469 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T04:45:22.469 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T04:45:22.470 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T04:45:22.470 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-01-25T04:45:22.470 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-01-25T04:45:22.470 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T04:45:22.470 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-01-25T04:45:22.470 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-01-25T04:45:22.471 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-01-25T04:45:22.471 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-25T04:45:22.471 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T04:45:22.471 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T04:45:22.471 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:22.472 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:45:22.472 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================================== 2023-01-25T04:45:22.472 INFO:teuthology.orchestra.run.smithi154.stdout:Install 13 Packages 2023-01-25T04:45:22.472 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:22.473 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 1.9 M 2023-01-25T04:45:22.473 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 25 M 2023-01-25T04:45:22.473 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:45:22.534 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:45:22.538 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:45:22.807 INFO:teuthology.orchestra.run.smithi154.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 49 kB/s | 16 kB 00:00 2023-01-25T04:45:22.843 INFO:teuthology.orchestra.run.smithi154.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 89 kB/s | 33 kB 00:00 2023-01-25T04:45:22.868 INFO:teuthology.orchestra.run.smithi154.stdout:(3/13): ceph-mgr-rook-18.0.0-1959.gb0d25925.el8 119 kB/s | 47 kB 00:00 2023-01-25T04:45:22.911 INFO:teuthology.orchestra.run.smithi154.stdout:(4/13): python3-google-auth-1.1.1-10.el8.noarch 786 kB/s | 81 kB 00:00 2023-01-25T04:45:22.961 INFO:teuthology.orchestra.run.smithi154.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 1.2 MB/s | 61 kB 00:00 2023-01-25T04:45:23.011 INFO:teuthology.orchestra.run.smithi154.stdout:(6/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.2 MB/s | 110 kB 00:00 2023-01-25T04:45:23.017 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:45:23.037 INFO:teuthology.orchestra.run.smithi154.stdout:(7/13): python3-rsa-4.8-1.el8.noarch.rpm 366 kB/s | 61 kB 00:00 2023-01-25T04:45:23.062 INFO:teuthology.orchestra.run.smithi154.stdout:(8/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 526 kB/s | 27 kB 00:00 2023-01-25T04:45:23.104 INFO:teuthology.orchestra.run.smithi154.stdout:(9/13): python3-jsonpointer-1.10-11.el8.noarch. 560 kB/s | 20 kB 00:00 2023-01-25T04:45:23.137 INFO:teuthology.orchestra.run.smithi154.stdout:(10/13): python3-kubernetes-11.0.0-6.el8.noarch 4.0 MB/s | 1.2 MB 00:00 2023-01-25T04:45:23.163 INFO:teuthology.orchestra.run.smithi154.stdout:(11/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-01-25T04:45:23.196 INFO:teuthology.orchestra.run.smithi154.stdout:(12/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 1.6 MB/s | 155 kB 00:00 2023-01-25T04:45:23.205 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T04:45:23.221 INFO:teuthology.orchestra.run.smithi154.stdout:(13/13): python3-requests-oauthlib-1.0.0-1.el8. 511 kB/s | 43 kB 00:00 2023-01-25T04:45:23.222 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:23.222 INFO:teuthology.orchestra.run.smithi154.stdout:Total 2.6 MB/s | 1.9 MB 00:00 2023-01-25T04:45:23.281 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:45:23.296 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:45:23.296 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:45:23.365 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:45:23.369 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:45:23.424 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.8-1.el8.noarch 2/13 2023-01-25T04:45:23.657 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-01-25T04:45:23.833 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:45:23.883 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2023-01-25T04:45:24.025 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T04:45:24.060 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2023-01-25T04:45:24.228 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2023-01-25T04:45:24.260 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.8-1.el8.noarch 2/13 2023-01-25T04:45:24.381 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2023-01-25T04:45:24.518 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-01-25T04:45:24.569 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-01-25T04:45:24.717 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T04:45:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2023-01-25T04:45:24.906 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-01-25T04:45:24.980 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2023-01-25T04:45:25.123 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2023-01-25T04:45:25.284 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2023-01-25T04:45:25.456 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-01-25T04:45:25.613 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T04:45:25.811 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-01-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-01-25T04:45:26.204 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-01-25T04:45:26.362 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 13/13 2023-01-25T04:45:26.609 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 13/13 2023-01-25T04:45:26.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 1/13 2023-01-25T04:45:26.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-01-25T04:45:26.610 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-01-25T04:45:26.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-01-25T04:45:26.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-01-25T04:45:26.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 6/13 2023-01-25T04:45:26.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-01-25T04:45:26.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 8/13 2023-01-25T04:45:26.611 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 9/13 2023-01-25T04:45:26.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 10/13 2023-01-25T04:45:26.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T04:45:26.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 12/13 2023-01-25T04:45:26.901 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-01-25T04:45:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-01-25T04:45:27.290 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 13/13 2023-01-25T04:45:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 13/13 2023-01-25T04:45:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 1/13 2023-01-25T04:45:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-01-25T04:45:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-01-25T04:45:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-01-25T04:45:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-01-25T04:45:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 6/13 2023-01-25T04:45:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-01-25T04:45:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 8/13 2023-01-25T04:45:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 9/13 2023-01-25T04:45:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 10/13 2023-01-25T04:45:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T04:45:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 12/13 2023-01-25T04:45:27.770 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 13/13 2023-01-25T04:45:27.770 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:24 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 13/13 2023-01-25T04:45:28.621 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:25 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:30.189 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:45:30.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:30.376 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:45:30.376 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:30.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T04:45:30.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T04:45:30.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T04:45:30.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T04:45:30.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T04:45:30.378 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T04:45:30.378 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T04:45:30.378 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T04:45:30.378 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T04:45:30.378 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T04:45:30.379 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T04:45:30.379 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T04:45:30.379 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:30.379 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:45:30.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T04:45:30.881 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:30.928 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:45:31.108 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:31.108 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:45:31.109 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:31.109 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T04:45:31.109 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T04:45:31.109 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T04:45:31.109 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T04:45:31.110 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T04:45:31.110 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T04:45:31.110 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T04:45:31.110 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T04:45:31.110 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T04:45:31.111 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T04:45:31.111 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T04:45:31.111 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T04:45:31.111 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:31.111 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:45:31.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T04:45:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:31.801 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:28 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:32.405 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:29 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:33.185 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:45:33.186 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================================== 2023-01-25T04:45:33.187 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:45:33.187 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================================== 2023-01-25T04:45:33.187 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:45:33.187 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 120 k 2023-01-25T04:45:33.187 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-25T04:45:33.188 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T04:45:33.188 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-01-25T04:45:33.188 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-01-25T04:45:33.188 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T04:45:33.188 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:33.189 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:45:33.189 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================================== 2023-01-25T04:45:33.189 INFO:teuthology.orchestra.run.smithi149.stdout:Install 5 Packages 2023-01-25T04:45:33.189 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:33.190 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 6.0 M 2023-01-25T04:45:33.190 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 26 M 2023-01-25T04:45:33.190 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:45:33.338 INFO:teuthology.orchestra.run.smithi149.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 404 kB/s | 60 kB 00:00 2023-01-25T04:45:33.372 INFO:teuthology.orchestra.run.smithi149.stdout:(2/5): ceph-mgr-cephadm-18.0.0-1959.gb0d25925.e 656 kB/s | 120 kB 00:00 2023-01-25T04:45:33.406 INFO:teuthology.orchestra.run.smithi149.stdout:(3/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 7.8 MB/s | 538 kB 00:00 2023-01-25T04:45:33.439 INFO:teuthology.orchestra.run.smithi149.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.9 MB/s | 476 kB 00:00 2023-01-25T04:45:33.539 INFO:teuthology.orchestra.run.smithi149.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2023-01-25T04:45:33.540 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:33.541 INFO:teuthology.orchestra.run.smithi149.stdout:Total 17 MB/s | 6.0 MB 00:00 2023-01-25T04:45:33.594 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:45:33.606 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:45:33.606 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:45:33.686 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:45:33.690 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:45:33.802 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:45:33.802 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================================== 2023-01-25T04:45:33.803 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:45:33.803 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================================== 2023-01-25T04:45:33.803 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:45:33.803 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 120 k 2023-01-25T04:45:33.803 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-01-25T04:45:33.804 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T04:45:33.804 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-01-25T04:45:33.804 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-01-25T04:45:33.804 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T04:45:33.805 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:33.805 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:45:33.805 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================================== 2023-01-25T04:45:33.805 INFO:teuthology.orchestra.run.smithi154.stdout:Install 5 Packages 2023-01-25T04:45:33.805 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:33.806 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 6.0 M 2023-01-25T04:45:33.806 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 26 M 2023-01-25T04:45:33.806 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:45:33.954 INFO:teuthology.orchestra.run.smithi154.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 404 kB/s | 60 kB 00:00 2023-01-25T04:45:34.004 INFO:teuthology.orchestra.run.smithi154.stdout:(2/5): ceph-mgr-cephadm-18.0.0-1959.gb0d25925.e 602 kB/s | 120 kB 00:00 2023-01-25T04:45:34.038 INFO:teuthology.orchestra.run.smithi154.stdout:(3/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.3 MB/s | 538 kB 00:00 2023-01-25T04:45:34.088 INFO:teuthology.orchestra.run.smithi154.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.6 MB/s | 476 kB 00:00 2023-01-25T04:45:34.172 INFO:teuthology.orchestra.run.smithi154.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2023-01-25T04:45:34.172 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:34.173 INFO:teuthology.orchestra.run.smithi154.stdout:Total 16 MB/s | 6.0 MB 00:00 2023-01-25T04:45:34.225 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:45:34.237 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:45:34.237 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:45:34.315 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:45:34.319 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:45:34.681 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:45:35.007 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 1/5 2023-01-25T04:45:35.238 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 2/5 2023-01-25T04:45:35.283 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:45:35.550 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-25T04:45:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 1/5 2023-01-25T04:45:35.806 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T04:45:35.841 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 2/5 2023-01-25T04:45:35.969 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 5/5 2023-01-25T04:45:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-25T04:45:36.206 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 5/5 2023-01-25T04:45:36.206 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/5 2023-01-25T04:45:36.206 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T04:45:36.206 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-25T04:45:36.207 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T04:45:36.442 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T04:45:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 5/5 2023-01-25T04:45:36.900 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 5/5 2023-01-25T04:45:36.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/5 2023-01-25T04:45:36.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T04:45:36.901 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-01-25T04:45:36.901 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T04:45:37.252 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 5/5 2023-01-25T04:45:37.252 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:34 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:37.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 5/5 2023-01-25T04:45:37.911 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:34 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:39.761 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:45:39.944 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:39.945 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:45:39.945 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:39.945 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T04:45:39.946 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T04:45:39.946 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T04:45:39.946 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T04:45:39.947 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:39.947 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:45:40.072 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-fuse 2023-01-25T04:45:40.244 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:45:40.425 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:40.427 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:45:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T04:45:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T04:45:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T04:45:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T04:45:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:40.428 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:45:40.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-fuse 2023-01-25T04:45:40.889 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:41.221 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:38 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:41.659 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:38 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:42.616 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:45:42.617 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:42.617 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:45:42.617 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:42.617 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:45:42.618 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse 2023-01-25T04:45:42.618 INFO:teuthology.orchestra.run.smithi149.stdout: x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 845 k 2023-01-25T04:45:42.618 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-25T04:45:42.618 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-01-25T04:45:42.618 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:42.619 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:45:42.619 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:42.619 INFO:teuthology.orchestra.run.smithi149.stdout:Install 2 Packages 2023-01-25T04:45:42.619 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:42.620 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 927 k 2023-01-25T04:45:42.620 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 2.9 M 2023-01-25T04:45:42.621 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:45:42.991 INFO:teuthology.orchestra.run.smithi149.stdout:(1/2): fuse-2.9.7-15.el8.x86_64.rpm 222 kB/s | 83 kB 00:00 2023-01-25T04:45:43.036 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:45:43.037 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:43.037 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:45:43.037 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:43.037 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:45:43.037 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse 2023-01-25T04:45:43.038 INFO:teuthology.orchestra.run.smithi154.stdout: x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 845 k 2023-01-25T04:45:43.038 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-01-25T04:45:43.038 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-01-25T04:45:43.038 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:43.038 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:45:43.039 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:43.039 INFO:teuthology.orchestra.run.smithi154.stdout:Install 2 Packages 2023-01-25T04:45:43.039 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:43.040 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 927 k 2023-01-25T04:45:43.040 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 2.9 M 2023-01-25T04:45:43.040 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:45:43.113 INFO:teuthology.orchestra.run.smithi154.stdout:(1/2): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-01-25T04:45:43.216 INFO:teuthology.orchestra.run.smithi149.stdout:(2/2): ceph-fuse-18.0.0-1959.gb0d25925.el8.x86_ 1.4 MB/s | 845 kB 00:00 2023-01-25T04:45:43.217 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:43.217 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.5 MB/s | 927 kB 00:00 2023-01-25T04:45:43.229 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:45:43.251 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:45:43.251 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:45:43.327 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:45:43.329 INFO:teuthology.orchestra.run.smithi154.stdout:(2/2): ceph-fuse-18.0.0-1959.gb0d25925.el8.x86_ 2.8 MB/s | 845 kB 00:00 2023-01-25T04:45:43.330 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:43.330 INFO:teuthology.orchestra.run.smithi154.stdout:Total 3.1 MB/s | 927 kB 00:00 2023-01-25T04:45:43.331 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:45:43.341 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:45:43.363 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:45:43.363 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:45:43.436 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:45:43.440 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:45:43.518 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:45:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:45:43.767 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2023-01-25T04:45:43.908 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2/2 2023-01-25T04:45:44.242 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2/2 2023-01-25T04:45:44.243 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/2 2023-01-25T04:45:44.603 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2023-01-25T04:45:45.293 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2023-01-25T04:45:45.294 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:42 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2/2 2023-01-25T04:45:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2/2 2023-01-25T04:45:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/2 2023-01-25T04:45:47.110 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2023-01-25T04:45:47.111 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:44 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:47.668 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:45:47.848 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:47.849 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:45:47.849 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2023-01-25T04:45:47.849 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:47.849 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:45:47.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-volume 2023-01-25T04:45:48.350 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:49.233 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:46 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:49.516 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:45:49.696 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:49.697 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:45:49.697 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2023-01-25T04:45:49.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:49.697 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:45:49.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-volume 2023-01-25T04:45:50.202 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:50.617 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:45:50.618 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:50.618 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-25T04:45:50.618 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:50.618 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:45:50.619 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 263 k 2023-01-25T04:45:50.619 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:50.619 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:45:50.619 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:50.619 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2023-01-25T04:45:50.619 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:50.620 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 263 k 2023-01-25T04:45:50.620 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 1.3 M 2023-01-25T04:45:50.620 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:45:50.977 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:47 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:51.131 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-volume-18.0.0-1959.gb0d25925.el8.noarch.rp 513 kB/s | 263 kB 00:00 2023-01-25T04:45:51.132 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:51.132 INFO:teuthology.orchestra.run.smithi149.stdout:Total 512 kB/s | 263 kB 00:00 2023-01-25T04:45:51.133 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:45:51.143 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:45:51.143 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:45:51.160 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:45:51.164 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:45:51.332 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:45:51.559 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:45:51.900 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:45:52.380 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:45:52.381 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:52.381 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-01-25T04:45:52.382 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:52.382 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:45:52.382 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 263 k 2023-01-25T04:45:52.382 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:52.382 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:45:52.383 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:52.383 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-01-25T04:45:52.383 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:52.383 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 263 k 2023-01-25T04:45:52.383 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 1.3 M 2023-01-25T04:45:52.383 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:45:52.862 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-volume-18.0.0-1959.gb0d25925.el8.noarch.rp 548 kB/s | 263 kB 00:00 2023-01-25T04:45:52.863 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:52.863 INFO:teuthology.orchestra.run.smithi154.stdout:Total 546 kB/s | 263 kB 00:00 2023-01-25T04:45:52.864 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:45:52.874 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:45:52.874 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:45:52.891 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:45:52.895 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:45:52.929 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:45:52.930 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:49 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:53.064 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:45:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:45:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:45:54.650 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:45:54.650 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:51 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:55.563 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:45:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:55.744 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:45:55.745 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:55.745 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:55.745 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:45:55.901 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados-devel 2023-01-25T04:45:56.258 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:57.071 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:45:57.128 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:54 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:57.249 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:57.249 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:45:57.250 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:45:57.250 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:57.250 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:45:57.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install librados-devel 2023-01-25T04:45:57.741 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:45:58.545 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:55 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:45:58.592 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:45:58.593 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:58.593 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2023-01-25T04:45:58.593 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:58.593 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:45:58.594 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 139 k 2023-01-25T04:45:58.594 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:58.594 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:45:58.594 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:45:58.594 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2023-01-25T04:45:58.595 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:45:58.595 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 139 k 2023-01-25T04:45:58.595 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 512 k 2023-01-25T04:45:58.595 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:45:58.847 INFO:teuthology.orchestra.run.smithi149.stdout:librados-devel-18.0.0-1959.gb0d25925.el8.x86_64 549 kB/s | 139 kB 00:00 2023-01-25T04:45:58.848 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:58.848 INFO:teuthology.orchestra.run.smithi149.stdout:Total 546 kB/s | 139 kB 00:00 2023-01-25T04:45:58.848 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:45:58.853 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:45:58.854 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:45:58.908 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:45:58.912 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:45:59.229 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:45:59.388 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:45:59.628 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:45:59.922 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:45:59.923 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:59.924 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repo Size 2023-01-25T04:45:59.924 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:59.924 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:45:59.924 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 139 k 2023-01-25T04:45:59.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:59.925 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:45:59.925 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:45:59.925 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-01-25T04:45:59.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:45:59.925 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 139 k 2023-01-25T04:45:59.926 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 512 k 2023-01-25T04:45:59.926 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi154.stdout:librados-devel-18.0.0-1959.gb0d25925.el8.x86_64 690 kB/s | 139 kB 00:00 2023-01-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi154.stdout:Total 685 kB/s | 139 kB 00:00 2023-01-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:46:00.132 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:46:00.133 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:46:00.188 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:46:00.192 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:46:00.317 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:46:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:00.687 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:00.688 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:02:57 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:00.698 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:01.736 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:02:58 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:03.296 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:46:03.479 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:03.479 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:46:03.479 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:03.480 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:03.480 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:03.641 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs2 2023-01-25T04:46:03.997 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:04.063 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:46:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:04.243 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:46:04.243 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:04.244 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:04.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install libcephfs2 2023-01-25T04:46:04.736 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:04.841 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:01 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:05.561 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:02 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:06.127 INFO:teuthology.orchestra.run.smithi149.stdout:Package libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:06.236 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:06.237 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:46:06.237 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:06.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs-devel 2023-01-25T04:46:06.733 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:06.856 INFO:teuthology.orchestra.run.smithi154.stdout:Package libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:06.961 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:06.962 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:46:06.963 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:07.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install libcephfs-devel 2023-01-25T04:46:07.445 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:07.561 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:04 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:08.385 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:05 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:08.948 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:08.949 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:08.949 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2023-01-25T04:46:08.950 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:08.950 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:46:08.950 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 30 k 2023-01-25T04:46:08.950 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:08.950 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:46:08.950 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:08.951 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2023-01-25T04:46:08.951 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:08.951 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 30 k 2023-01-25T04:46:08.951 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 137 k 2023-01-25T04:46:08.952 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:46:09.099 INFO:teuthology.orchestra.run.smithi149.stdout:libcephfs-devel-18.0.0-1959.gb0d25925.el8.x86_6 204 kB/s | 30 kB 00:00 2023-01-25T04:46:09.100 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:09.100 INFO:teuthology.orchestra.run.smithi149.stdout:Total 202 kB/s | 30 kB 00:00 2023-01-25T04:46:09.101 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:46:09.104 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:46:09.104 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:46:09.115 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:46:09.119 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:46:09.178 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:46:09.361 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:09.573 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:09.776 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:09.777 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repo Size 2023-01-25T04:46:09.777 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:09.777 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:46:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 30 k 2023-01-25T04:46:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:09.778 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:46:09.778 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:09.778 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-01-25T04:46:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:09.779 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 30 k 2023-01-25T04:46:09.779 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 137 k 2023-01-25T04:46:09.779 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:46:09.933 INFO:teuthology.orchestra.run.smithi154.stdout:libcephfs-devel-18.0.0-1959.gb0d25925.el8.x86_6 196 kB/s | 30 kB 00:00 2023-01-25T04:46:09.934 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:09.934 INFO:teuthology.orchestra.run.smithi154.stdout:Total 195 kB/s | 30 kB 00:00 2023-01-25T04:46:09.934 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:46:09.937 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:46:09.938 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:46:09.948 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:46:09.952 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:46:10.010 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:46:10.197 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:10.410 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:10.675 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:10.675 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:07 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:11.384 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:11.385 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:08 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:13.120 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:46:13.302 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:13.302 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:46:13.302 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:13.303 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:13.303 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:13.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados2 2023-01-25T04:46:13.708 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:46:13.804 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:13.891 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:13.892 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:46:13.892 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:13.892 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:13.892 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:14.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install librados2 2023-01-25T04:46:14.376 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:14.599 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:11 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:15.149 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:12 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:15.872 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:15.982 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:15.983 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:46:15.983 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:16.118 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librbd1 2023-01-25T04:46:16.425 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:16.473 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:16.534 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:16.535 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:46:16.535 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:16.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install librbd1 2023-01-25T04:46:16.994 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:17.274 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:14 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:17.794 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:14 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:18.603 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:18.710 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:18.711 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:46:18.712 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:18.849 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rados 2023-01-25T04:46:19.139 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:19.201 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:19.247 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:19.249 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:46:19.249 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:19.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install python3-rados 2023-01-25T04:46:19.725 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:19.997 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:16 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:20.518 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:17 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:21.293 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:21.406 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:21.407 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:46:21.407 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:21.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rgw 2023-01-25T04:46:21.863 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:21.887 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:21.973 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:21.974 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:46:21.974 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:22.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install python3-rgw 2023-01-25T04:46:22.434 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:22.719 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:19 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:23.213 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:20 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:24.024 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:24.131 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:24.133 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:46:24.133 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:24.274 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-cephfs 2023-01-25T04:46:24.610 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:24.629 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:24.719 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:24.720 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:46:24.720 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:24.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install python3-cephfs 2023-01-25T04:46:25.191 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:25.406 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:22 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:26.006 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:23 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:26.680 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:26.788 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:26.790 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:46:26.790 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:26.922 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rbd 2023-01-25T04:46:27.277 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:27.297 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:27.405 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:27.406 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:46:27.407 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:27.523 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install python3-rbd 2023-01-25T04:46:27.876 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:28.060 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:25 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:28.663 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:25 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:29.329 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:29.437 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:29.438 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-25T04:46:29.439 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:29.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-fuse 2023-01-25T04:46:29.920 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:29.930 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:46:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-01-25T04:46:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:30.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install rbd-fuse 2023-01-25T04:46:30.500 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:30.734 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:27 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:28 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:32.118 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:32.119 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2023-01-25T04:46:32.120 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:32.120 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:46:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 94 k 2023-01-25T04:46:32.120 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:32.121 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:46:32.121 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:32.121 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2023-01-25T04:46:32.121 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:32.121 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 94 k 2023-01-25T04:46:32.122 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 280 k 2023-01-25T04:46:32.122 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:46:32.311 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-fuse-18.0.0-1959.gb0d25925.el8.x86_64.rpm 495 kB/s | 94 kB 00:00 2023-01-25T04:46:32.312 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:32.312 INFO:teuthology.orchestra.run.smithi149.stdout:Total 492 kB/s | 94 kB 00:00 2023-01-25T04:46:32.312 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:46:32.322 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:46:32.322 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:46:32.377 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:46:32.380 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:46:32.496 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:46:32.649 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:32.888 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:32.999 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:33.000 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2023-01-25T04:46:33.000 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:33.001 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:46:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 94 k 2023-01-25T04:46:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:33.001 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:46:33.001 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:33.002 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-01-25T04:46:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:33.002 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 94 k 2023-01-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 280 k 2023-01-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:46:33.214 INFO:teuthology.orchestra.run.smithi154.stdout:rbd-fuse-18.0.0-1959.gb0d25925.el8.x86_64.rpm 443 kB/s | 94 kB 00:00 2023-01-25T04:46:33.215 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:33.215 INFO:teuthology.orchestra.run.smithi154.stdout:Total 441 kB/s | 94 kB 00:00 2023-01-25T04:46:33.215 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:46:33.226 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:46:33.226 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:46:33.280 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:46:33.284 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:46:33.411 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:46:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:33.815 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:33.936 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:33.936 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:30 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:34.846 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:34.847 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:31 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:36.500 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:46:36.683 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:36.684 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:46:36.684 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:36.684 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:36.684 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:36.840 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-mirror 2023-01-25T04:46:37.202 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:37.523 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:46:37.702 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:46:37.702 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:37.703 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:37.703 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:37.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install rbd-mirror 2023-01-25T04:46:38.016 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:35 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:38.192 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:39.007 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:36 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:39.402 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:39.403 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:39.403 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2023-01-25T04:46:39.403 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:39.404 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:46:39.404 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.4 M 2023-01-25T04:46:39.404 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:39.404 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:46:39.404 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:39.405 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2023-01-25T04:46:39.405 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:39.405 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 3.4 M 2023-01-25T04:46:39.405 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 16 M 2023-01-25T04:46:39.405 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:46:40.205 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-mirror-18.0.0-1959.gb0d25925.el8.x86_64.rpm 4.3 MB/s | 3.4 MB 00:00 2023-01-25T04:46:40.205 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:40.206 INFO:teuthology.orchestra.run.smithi149.stdout:Total 4.3 MB/s | 3.4 MB 00:00 2023-01-25T04:46:40.206 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:46:40.218 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:46:40.218 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:46:40.285 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:46:40.289 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:46:40.410 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:40.411 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repo Size 2023-01-25T04:46:40.411 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:40.411 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:46:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.4 M 2023-01-25T04:46:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:40.412 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:46:40.412 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:40.412 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-01-25T04:46:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:40.413 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 3.4 M 2023-01-25T04:46:40.413 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 16 M 2023-01-25T04:46:40.413 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:46:40.853 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:46:41.059 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:41.173 INFO:teuthology.orchestra.run.smithi154.stdout:rbd-mirror-18.0.0-1959.gb0d25925.el8.x86_64.rpm 4.5 MB/s | 3.4 MB 00:00 2023-01-25T04:46:41.173 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:41.174 INFO:teuthology.orchestra.run.smithi154.stdout:Total 4.5 MB/s | 3.4 MB 00:00 2023-01-25T04:46:41.174 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:46:41.186 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:46:41.187 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:46:41.253 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:46:41.257 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:46:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:46:41.870 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:42.228 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:42.501 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:42.501 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:39 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:43.295 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:43.295 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:40 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:45.069 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:46:45.250 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:45.250 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:46:45.250 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:45.250 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:45.251 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:45.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-nbd 2023-01-25T04:46:45.750 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:45.922 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:46:46.105 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:46.105 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:46:46.105 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:46.106 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:46.106 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:46.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install rbd-nbd 2023-01-25T04:46:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:43 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:46.592 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-01-25T04:46:47.404 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:44 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:47.940 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-25T04:46:47.941 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:47.941 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2023-01-25T04:46:47.942 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:47.942 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-25T04:46:47.942 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 179 k 2023-01-25T04:46:47.942 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:47.942 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-25T04:46:47.943 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-01-25T04:46:47.943 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2023-01-25T04:46:47.943 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:47.943 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 179 k 2023-01-25T04:46:47.943 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 568 k 2023-01-25T04:46:47.944 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-25T04:46:48.166 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-nbd-18.0.0-1959.gb0d25925.el8.x86_64.rpm 803 kB/s | 179 kB 00:00 2023-01-25T04:46:48.167 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:48.167 INFO:teuthology.orchestra.run.smithi149.stdout:Total 799 kB/s | 179 kB 00:00 2023-01-25T04:46:48.167 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-25T04:46:48.178 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-25T04:46:48.178 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-25T04:46:48.231 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-25T04:46:48.235 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-25T04:46:48.362 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-25T04:46:48.514 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:48.756 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:48.857 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-01-25T04:46:48.858 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2023-01-25T04:46:48.858 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:48.858 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-01-25T04:46:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 179 k 2023-01-25T04:46:48.859 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:48.859 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-01-25T04:46:48.859 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-01-25T04:46:48.859 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-01-25T04:46:48.859 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:48.860 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 179 k 2023-01-25T04:46:48.860 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 568 k 2023-01-25T04:46:48.860 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-01-25T04:46:49.051 INFO:teuthology.orchestra.run.smithi154.stdout:rbd-nbd-18.0.0-1959.gb0d25925.el8.x86_64.rpm 933 kB/s | 179 kB 00:00 2023-01-25T04:46:49.052 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:49.052 INFO:teuthology.orchestra.run.smithi154.stdout:Total 927 kB/s | 179 kB 00:00 2023-01-25T04:46:49.052 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-01-25T04:46:49.063 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-01-25T04:46:49.063 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-01-25T04:46:49.116 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-01-25T04:46:49.120 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-01-25T04:46:49.236 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-01-25T04:46:49.407 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:49.664 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:49.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:49.841 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:46 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:46:50.697 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:47 ago on Wed 25 Jan 2023 04:43:03 AM UTC. 2023-01-25T04:46:52.297 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-25T04:46:52.477 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:52.477 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-25T04:46:52.477 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:52.477 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:52.477 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-25T04:46:52.644 DEBUG:teuthology.parallel:result is None 2023-01-25T04:46:53.274 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-01-25T04:46:53.456 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:53.456 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-01-25T04:46:53.456 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:46:53.456 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:53.457 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-01-25T04:46:53.591 DEBUG:teuthology.parallel:result is None 2023-01-25T04:46:53.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-25T04:46:53.641 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2023-01-25T04:46:53.643 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T04:46:53.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:46:53.794 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T04:46:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:18.0.0-1959.gb0d25925.el8 2023-01-25T04:46:53.819 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1959.gb0d25925.el8 2023-01-25T04:46:53.819 INFO:teuthology.task.install:The correct ceph version 18.0.0-1959.gb0d25925 is installed. 2023-01-25T04:46:53.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo lsb_release -is 2023-01-25T04:46:53.862 INFO:teuthology.orchestra.run.smithi154.stdout:RedHatEnterprise 2023-01-25T04:46:53.863 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-25T04:46:53.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:46:54.017 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T04:46:54.039 INFO:teuthology.orchestra.run.smithi154.stdout:18.0.0-1959.gb0d25925.el8 2023-01-25T04:46:54.040 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1959.gb0d25925.el8 2023-01-25T04:46:54.040 INFO:teuthology.task.install:The correct ceph version 18.0.0-1959.gb0d25925 is installed. 2023-01-25T04:46:54.040 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T04:46:54.041 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:54.041 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T04:46:54.072 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:46:54.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T04:46:54.105 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T04:46:54.106 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:54.106 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T04:46:54.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T04:46:54.212 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:46:54.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T04:46:54.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T04:46:54.305 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T04:46:54.305 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:54.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T04:46:54.334 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T04:46:54.403 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:46:54.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T04:46:54.429 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T04:46:54.495 INFO:teuthology.run_tasks:Running task ceph... 2023-01-25T04:46:54.558 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-25T04:46:54.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2023-01-25T04:46:54.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2023-01-25T04:46:54.588 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-25T04:46:54.588 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T04:46:54.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T04:46:54.655 INFO:tasks.ceph:Creating extra log directories... 2023-01-25T04:46:54.655 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T04:46:54.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T04:46:54.733 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-25T04:46:54.734 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-25T04:46:54.734 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136766', 'branch': 'wip-yuri-testing-2023-01-23-0926', 'description': 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7136766', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-01-23-0926'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-yuri-testing-2023-01-23-0926', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri-testing-2023-01-23-0926', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_b0d2592529629ab4f86fed5991e556a87dcda563/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'targets': {'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi154.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'cluster': 'ceph'}}, {'thrashosds': {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250', 'sudo ceph osd pool set cache min_read_recency_for_promote 2', 'sudo ceph osd pool set cache min_write_recency_for_promote 2']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'write': 100}, 'ops': 4000, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_22:20:59', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-25T04:46:54.735 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T04:46:54.763 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T04:46:54.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T04:46:54.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T04:46:54.848 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:54.848 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T04:46:54.905 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T04:46:54.905 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2023-01-25T04:46:54.962 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T04:46:54.962 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:46:54.963 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 348612 Links: 1 2023-01-25T04:46:54.963 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:46:54.963 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:46:54.963 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-25 04:46:41.220104981 +0000 2023-01-25T04:46:54.964 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-25 04:42:18.594355349 +0000 2023-01-25T04:46:54.964 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-25 04:42:18.594355349 +0000 2023-01-25T04:46:54.964 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-25T04:46:54.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T04:46:55.027 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-25T04:46:55.027 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-25T04:46:55.028 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000235039 s, 2.2 MB/s 2023-01-25T04:46:55.029 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T04:46:55.086 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2023-01-25T04:46:55.144 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T04:46:55.144 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:46:55.144 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 348977 Links: 1 2023-01-25T04:46:55.144 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:46:55.145 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:46:55.145 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-25 04:46:41.220104981 +0000 2023-01-25T04:46:55.145 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-25 04:42:19.101345131 +0000 2023-01-25T04:46:55.145 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-25 04:42:19.101345131 +0000 2023-01-25T04:46:55.145 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-25T04:46:55.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T04:46:55.209 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-25T04:46:55.209 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-25T04:46:55.209 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000248608 s, 2.1 MB/s 2023-01-25T04:46:55.211 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T04:46:55.269 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2023-01-25T04:46:55.326 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T04:46:55.326 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:46:55.326 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 352210 Links: 1 2023-01-25T04:46:55.327 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:46:55.327 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:46:55.327 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-25 04:46:41.220104981 +0000 2023-01-25T04:46:55.327 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-25 04:42:19.605334974 +0000 2023-01-25T04:46:55.327 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-25 04:42:19.605334974 +0000 2023-01-25T04:46:55.328 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-25T04:46:55.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T04:46:55.391 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-25T04:46:55.391 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-25T04:46:55.391 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000206735 s, 2.5 MB/s 2023-01-25T04:46:55.392 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T04:46:55.449 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2023-01-25T04:46:55.507 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T04:46:55.508 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:46:55.508 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 352929 Links: 1 2023-01-25T04:46:55.508 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:46:55.508 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:46:55.508 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-25 04:46:41.220104981 +0000 2023-01-25T04:46:55.509 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-25 04:42:20.122324555 +0000 2023-01-25T04:46:55.509 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-25 04:42:20.122324555 +0000 2023-01-25T04:46:55.509 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-25T04:46:55.510 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T04:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-25T04:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-25T04:46:55.572 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000196203 s, 2.6 MB/s 2023-01-25T04:46:55.574 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T04:46:55.631 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T04:46:55.632 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:46:55.632 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T04:46:55.651 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T04:46:55.651 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2023-01-25T04:46:55.710 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T04:46:55.710 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:46:55.710 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 350607 Links: 1 2023-01-25T04:46:55.710 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:46:55.711 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:46:55.711 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-01-25 04:46:42.029088572 +0000 2023-01-25T04:46:55.711 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-01-25 04:42:18.404661683 +0000 2023-01-25T04:46:55.711 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-01-25 04:42:18.404661683 +0000 2023-01-25T04:46:55.711 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-01-25T04:46:55.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T04:46:55.777 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-01-25T04:46:55.778 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-01-25T04:46:55.778 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000261709 s, 2.0 MB/s 2023-01-25T04:46:55.779 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T04:46:55.838 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2023-01-25T04:46:55.896 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T04:46:55.896 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:46:55.897 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 359452 Links: 1 2023-01-25T04:46:55.897 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:46:55.897 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:46:55.897 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-01-25 04:46:42.029088572 +0000 2023-01-25T04:46:55.897 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-01-25 04:42:18.893648616 +0000 2023-01-25T04:46:55.898 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-01-25 04:42:18.893648616 +0000 2023-01-25T04:46:55.898 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-01-25T04:46:55.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T04:46:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-01-25T04:46:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-01-25T04:46:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000242428 s, 2.1 MB/s 2023-01-25T04:46:55.963 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T04:46:56.021 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2023-01-25T04:46:56.079 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T04:46:56.079 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:46:56.079 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 357631 Links: 1 2023-01-25T04:46:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:46:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:46:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-01-25 04:46:42.030088546 +0000 2023-01-25T04:46:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-01-25 04:42:19.375635736 +0000 2023-01-25T04:46:56.081 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-01-25 04:42:19.375635736 +0000 2023-01-25T04:46:56.081 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-01-25T04:46:56.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T04:46:56.144 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-01-25T04:46:56.144 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-01-25T04:46:56.144 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000219335 s, 2.3 MB/s 2023-01-25T04:46:56.145 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T04:46:56.202 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2023-01-25T04:46:56.259 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T04:46:56.259 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:46:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 359582 Links: 1 2023-01-25T04:46:56.259 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:46:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:46:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-01-25 04:46:42.030088546 +0000 2023-01-25T04:46:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-01-25 04:42:19.892621922 +0000 2023-01-25T04:46:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-01-25 04:42:19.892621922 +0000 2023-01-25T04:46:56.261 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-01-25T04:46:56.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T04:46:56.323 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-01-25T04:46:56.324 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-01-25T04:46:56.324 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000197063 s, 2.6 MB/s 2023-01-25T04:46:56.325 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T04:46:56.383 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T04:46:56.383 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T04:46:56.383 INFO:tasks.ceph:Generating config... 2023-01-25T04:46:56.385 INFO:tasks.ceph:[osd] debug monc = 20 2023-01-25T04:46:56.385 INFO:tasks.ceph:[osd] bdev async discard = True 2023-01-25T04:46:56.385 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-01-25T04:46:56.386 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-01-25T04:46:56.386 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-25T04:46:56.386 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-25T04:46:56.387 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-25T04:46:56.387 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-25T04:46:56.387 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-25T04:46:56.387 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-25T04:46:56.388 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-25T04:46:56.388 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-25T04:46:56.388 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-25T04:46:56.389 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-25T04:46:56.389 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-25T04:46:56.389 INFO:tasks.ceph:[osd] osd backoff on peering = True 2023-01-25T04:46:56.389 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-01-25T04:46:56.390 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2023-01-25T04:46:56.390 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-25T04:46:56.390 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-25T04:46:56.391 INFO:tasks.ceph:[osd] osd delete sleep = 1 2023-01-25T04:46:56.391 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-25T04:46:56.391 INFO:tasks.ceph:[osd] osd max backfills = 3 2023-01-25T04:46:56.391 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-25T04:46:56.392 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-25T04:46:56.392 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-25T04:46:56.392 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-25T04:46:56.393 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-25T04:46:56.393 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2023-01-25T04:46:56.393 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2023-01-25T04:46:56.393 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-25T04:46:56.394 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2023-01-25T04:46:56.394 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2023-01-25T04:46:56.394 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2023-01-25T04:46:56.395 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-01-25T04:46:56.395 INFO:tasks.ceph:[global] mon election default strategy = 3 2023-01-25T04:46:56.395 INFO:tasks.ceph:[global] ms bind msgr1 = False 2023-01-25T04:46:56.395 INFO:tasks.ceph:[global] ms bind msgr2 = True 2023-01-25T04:46:56.396 INFO:tasks.ceph:[global] ms inject delay max = 1 2023-01-25T04:46:56.396 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2023-01-25T04:46:56.396 INFO:tasks.ceph:[global] ms inject delay type = osd 2023-01-25T04:46:56.396 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2023-01-25T04:46:56.397 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2023-01-25T04:46:56.397 INFO:tasks.ceph:[global] ms type = async 2023-01-25T04:46:56.397 INFO:tasks.ceph:[global] osd_async_recovery_min_cost = 1 2023-01-25T04:46:56.398 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 2 2023-01-25T04:46:56.398 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 1 2023-01-25T04:46:56.398 INFO:tasks.ceph:[global] osd_object_clean_region_max_num_intervals = 1000 2023-01-25T04:46:56.398 INFO:tasks.ceph:[global] osd_pg_log_trim_min = 0 2023-01-25T04:46:56.399 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2023-01-25T04:46:56.399 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2023-01-25T04:46:56.399 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-25T04:46:56.399 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-25T04:46:56.400 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-25T04:46:56.400 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-25T04:46:56.400 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-25T04:46:56.401 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-01-25T04:46:56.401 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-01-25T04:46:56.401 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-01-25T04:46:56.401 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-01-25T04:46:56.402 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-25T04:46:56.402 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-01-25T04:46:56.402 INFO:tasks.ceph:Setting up mon.a... 2023-01-25T04:46:56.403 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-25T04:46:56.464 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.keyring 2023-01-25T04:46:56.467 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-25T04:46:56.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T04:46:56.542 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.149'), ('mon.c', '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]'), ('mon.b', '172.21.15.154')] 2023-01-25T04:46:56.542 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790],172.21.15.154', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-25T04:46:56.543 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:56.544 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T04:46:56.599 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.149 --addv c '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]' --add b 172.21.15.154 --print /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:46:56.688 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:46:56.688 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: generated fsid 629f2296-7568-47e9-b1d7-daec4aeb5f55 2023-01-25T04:46:56.689 INFO:teuthology.orchestra.run.smithi149.stdout:setting min_mon_release = pacific 2023-01-25T04:46:56.689 INFO:teuthology.orchestra.run.smithi149.stdout:epoch 0 2023-01-25T04:46:56.689 INFO:teuthology.orchestra.run.smithi149.stdout:fsid 629f2296-7568-47e9-b1d7-daec4aeb5f55 2023-01-25T04:46:56.689 INFO:teuthology.orchestra.run.smithi149.stdout:last_changed 2023-01-25T04:46:56.688210+0000 2023-01-25T04:46:56.690 INFO:teuthology.orchestra.run.smithi149.stdout:created 2023-01-25T04:46:56.688210+0000 2023-01-25T04:46:56.690 INFO:teuthology.orchestra.run.smithi149.stdout:min_mon_release 16 (pacific) 2023-01-25T04:46:56.690 INFO:teuthology.orchestra.run.smithi149.stdout:election_strategy: 3 2023-01-25T04:46:56.690 INFO:teuthology.orchestra.run.smithi149.stdout:0: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.a 2023-01-25T04:46:56.690 INFO:teuthology.orchestra.run.smithi149.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2023-01-25T04:46:56.691 INFO:teuthology.orchestra.run.smithi149.stdout:2: [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] mon.c 2023-01-25T04:46:56.691 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-25T04:46:56.692 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T04:46:56.709 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 629f2296-7568-47e9-b1d7-daec4aeb5f55... 2023-01-25T04:46:56.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T04:46:56.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T04:46:56.794 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-01-25T04:46:56.794 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-01-25T04:46:56.794 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T04:46:56.794 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-01-25T04:46:56.795 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.795 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-01-25T04:46:56.795 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.795 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-01-25T04:46:56.795 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.796 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-01-25T04:46:56.796 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-01-25T04:46:56.796 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.796 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-01-25T04:46:56.796 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-01-25T04:46:56.797 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.797 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T04:46:56.797 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-01-25T04:46:56.797 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.797 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T04:46:56.798 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T04:46:56.798 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.798 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-01-25T04:46:56.798 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.798 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-01-25T04:46:56.799 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-01-25T04:46:56.799 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-01-25T04:46:56.799 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-01-25T04:46:56.799 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-01-25T04:46:56.799 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-01-25T04:46:56.799 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-01-25T04:46:56.800 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T04:46:56.800 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T04:46:56.800 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-01-25T04:46:56.800 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.800 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T04:46:56.801 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.801 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-01-25T04:46:56.801 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.801 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-01-25T04:46:56.801 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-01-25T04:46:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-01-25T04:46:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-01-25T04:46:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790],172.21.15.154" 2023-01-25T04:46:56.802 INFO:teuthology.orchestra.run.smithi149.stdout: mon client directed command retry = 5 2023-01-25T04:46:56.803 INFO:teuthology.orchestra.run.smithi149.stdout: mon election default strategy = 3 2023-01-25T04:46:56.803 INFO:teuthology.orchestra.run.smithi149.stdout: ms bind msgr1 = False 2023-01-25T04:46:56.803 INFO:teuthology.orchestra.run.smithi149.stdout: ms bind msgr2 = True 2023-01-25T04:46:56.803 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay max = 1 2023-01-25T04:46:56.803 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay probability = 0.005 2023-01-25T04:46:56.804 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject delay type = osd 2023-01-25T04:46:56.804 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject internal delays = 0.002 2023-01-25T04:46:56.804 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject socket failures = 2500 2023-01-25T04:46:56.804 INFO:teuthology.orchestra.run.smithi149.stdout: ms type = async 2023-01-25T04:46:56.804 INFO:teuthology.orchestra.run.smithi149.stdout: osd_async_recovery_min_cost = 1 2023-01-25T04:46:56.805 INFO:teuthology.orchestra.run.smithi149.stdout: osd_max_pg_log_entries = 2 2023-01-25T04:46:56.805 INFO:teuthology.orchestra.run.smithi149.stdout: osd_min_pg_log_entries = 1 2023-01-25T04:46:56.805 INFO:teuthology.orchestra.run.smithi149.stdout: osd_object_clean_region_max_num_intervals = 1000 2023-01-25T04:46:56.805 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pg_log_trim_min = 0 2023-01-25T04:46:56.805 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_min_size = 2 2023-01-25T04:46:56.806 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_size = 3 2023-01-25T04:46:56.806 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 629f2296-7568-47e9-b1d7-daec4aeb5f55 2023-01-25T04:46:56.806 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.806 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-01-25T04:46:56.806 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-01-25T04:46:56.807 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.807 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-01-25T04:46:56.807 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 120 2023-01-25T04:46:56.807 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.807 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-01-25T04:46:56.807 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-01-25T04:46:56.808 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.808 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-01-25T04:46:56.808 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-01-25T04:46:56.808 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-01-25T04:46:56.808 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.809 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-01-25T04:46:56.809 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-01-25T04:46:56.809 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.809 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-01-25T04:46:56.809 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.809 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-01-25T04:46:56.810 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.810 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-01-25T04:46:56.810 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.810 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-01-25T04:46:56.810 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-01-25T04:46:56.810 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-01-25T04:46:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-01-25T04:46:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: debug monc = 20 2023-01-25T04:46:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2023-01-25T04:46:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2023-01-25T04:46:56.812 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = stupid 2023-01-25T04:46:56.812 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-01-25T04:46:56.812 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-01-25T04:46:56.812 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore zero block detection = True 2023-01-25T04:46:56.812 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2023-01-25T04:46:56.813 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2023-01-25T04:46:56.813 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-25T04:46:56.813 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-01-25T04:46:56.813 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2023-01-25T04:46:56.813 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T04:46:56.813 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-01-25T04:46:56.814 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-01-25T04:46:56.814 INFO:teuthology.orchestra.run.smithi149.stdout: osd backoff on peering = True 2023-01-25T04:46:56.814 INFO:teuthology.orchestra.run.smithi149.stdout: osd blocked scrub grace period = 3600 2023-01-25T04:46:56.814 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug reject backfill probability = 0.3 2023-01-25T04:46:56.815 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify cached snaps = True 2023-01-25T04:46:56.815 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify missing on start = True 2023-01-25T04:46:56.815 INFO:teuthology.orchestra.run.smithi149.stdout: osd delete sleep = 1 2023-01-25T04:46:56.815 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-01-25T04:46:56.815 INFO:teuthology.orchestra.run.smithi149.stdout: osd max backfills = 3 2023-01-25T04:46:56.815 INFO:teuthology.orchestra.run.smithi149.stdout: osd max markdown count = 1000 2023-01-25T04:46:56.816 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock override recovery settings = True 2023-01-25T04:46:56.816 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-01-25T04:46:56.816 INFO:teuthology.orchestra.run.smithi149.stdout: osd op queue = debug_random 2023-01-25T04:46:56.816 INFO:teuthology.orchestra.run.smithi149.stdout: osd op queue cut off = debug_random 2023-01-25T04:46:56.816 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub min interval = 60 2023-01-25T04:46:56.817 INFO:teuthology.orchestra.run.smithi149.stdout: osd shutdown pgref assert = True 2023-01-25T04:46:56.817 INFO:teuthology.orchestra.run.smithi149.stdout: osd snap trim sleep = 2 2023-01-25T04:46:56.817 INFO:teuthology.orchestra.run.smithi149.stdout: osd_max_pg_log_entries = 3000 2023-01-25T04:46:56.817 INFO:teuthology.orchestra.run.smithi149.stdout: osd_min_pg_log_entries = 3000 2023-01-25T04:46:56.817 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.817 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-01-25T04:46:56.818 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-25T04:46:56.818 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-01-25T04:46:56.818 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-01-25T04:46:56.818 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-01-25T04:46:56.818 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-01-25T04:46:56.819 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-01-25T04:46:56.819 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-01-25T04:46:56.819 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.819 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-01-25T04:46:56.819 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-25T04:46:56.819 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-01-25T04:46:56.820 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-01-25T04:46:56.820 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-01-25T04:46:56.820 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-01-25T04:46:56.820 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-01-25T04:46:56.820 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-01-25T04:46:56.821 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-01-25T04:46:56.821 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-01-25T04:46:56.821 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-01-25T04:46:56.821 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.821 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T04:46:56.821 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T04:46:56.822 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T04:46:56.822 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.822 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T04:46:56.822 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T04:46:56.822 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T04:46:56.823 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.823 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-01-25T04:46:56.823 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-01-25T04:46:56.823 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.823 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-01-25T04:46:56.824 INFO:teuthology.orchestra.run.smithi149.stdout: mon min osdmap epochs = 50 2023-01-25T04:46:56.824 INFO:teuthology.orchestra.run.smithi149.stdout: mon osdmap full prune interval = 2 2023-01-25T04:46:56.824 INFO:teuthology.orchestra.run.smithi149.stdout: mon osdmap full prune min = 15 2023-01-25T04:46:56.824 INFO:teuthology.orchestra.run.smithi149.stdout: mon osdmap full prune txsize = 2 2023-01-25T04:46:56.824 INFO:teuthology.orchestra.run.smithi149.stdout: mon scrub interval = 300 2023-01-25T04:46:56.824 INFO:teuthology.orchestra.run.smithi149.stdout: paxos service trim min = 10 2023-01-25T04:46:56.825 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:46:56.825 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-01-25T04:46:56.825 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-01-25T04:46:56.825 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-01-25T04:46:56.825 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-01-25T04:46:56.825 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T04:46:56.826 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T04:46:56.826 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-01-25T04:46:56.826 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-01-25T04:46:56.826 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-01-25T04:46:56.828 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2023-01-25T04:46:56.828 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2023-01-25T04:46:56.828 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T04:46:56.828 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2023-01-25T04:46:56.828 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.829 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2023-01-25T04:46:56.829 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.829 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2023-01-25T04:46:56.829 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.829 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2023-01-25T04:46:56.830 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2023-01-25T04:46:56.830 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.830 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2023-01-25T04:46:56.830 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2023-01-25T04:46:56.830 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.831 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T04:46:56.831 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2023-01-25T04:46:56.831 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.831 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T04:46:56.831 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T04:46:56.832 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.832 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2023-01-25T04:46:56.832 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.832 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2023-01-25T04:46:56.832 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2023-01-25T04:46:56.833 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2023-01-25T04:46:56.833 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2023-01-25T04:46:56.833 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2023-01-25T04:46:56.833 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2023-01-25T04:46:56.833 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2023-01-25T04:46:56.833 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T04:46:56.834 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T04:46:56.834 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2023-01-25T04:46:56.834 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.834 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T04:46:56.834 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.835 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2023-01-25T04:46:56.835 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.835 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2023-01-25T04:46:56.835 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.835 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2023-01-25T04:46:56.836 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2023-01-25T04:46:56.836 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2023-01-25T04:46:56.836 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790],172.21.15.154" 2023-01-25T04:46:56.836 INFO:teuthology.orchestra.run.smithi154.stdout: mon client directed command retry = 5 2023-01-25T04:46:56.836 INFO:teuthology.orchestra.run.smithi154.stdout: mon election default strategy = 3 2023-01-25T04:46:56.837 INFO:teuthology.orchestra.run.smithi154.stdout: ms bind msgr1 = False 2023-01-25T04:46:56.837 INFO:teuthology.orchestra.run.smithi154.stdout: ms bind msgr2 = True 2023-01-25T04:46:56.837 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay max = 1 2023-01-25T04:46:56.837 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay probability = 0.005 2023-01-25T04:46:56.837 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay type = osd 2023-01-25T04:46:56.837 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject internal delays = 0.002 2023-01-25T04:46:56.838 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject socket failures = 2500 2023-01-25T04:46:56.838 INFO:teuthology.orchestra.run.smithi154.stdout: ms type = async 2023-01-25T04:46:56.838 INFO:teuthology.orchestra.run.smithi154.stdout: osd_async_recovery_min_cost = 1 2023-01-25T04:46:56.838 INFO:teuthology.orchestra.run.smithi154.stdout: osd_max_pg_log_entries = 2 2023-01-25T04:46:56.838 INFO:teuthology.orchestra.run.smithi154.stdout: osd_min_pg_log_entries = 1 2023-01-25T04:46:56.839 INFO:teuthology.orchestra.run.smithi154.stdout: osd_object_clean_region_max_num_intervals = 1000 2023-01-25T04:46:56.839 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pg_log_trim_min = 0 2023-01-25T04:46:56.839 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_min_size = 2 2023-01-25T04:46:56.839 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_size = 3 2023-01-25T04:46:56.839 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 629f2296-7568-47e9-b1d7-daec4aeb5f55 2023-01-25T04:46:56.839 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.840 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2023-01-25T04:46:56.840 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2023-01-25T04:46:56.840 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.840 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2023-01-25T04:46:56.841 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 120 2023-01-25T04:46:56.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.841 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2023-01-25T04:46:56.841 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2023-01-25T04:46:56.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.842 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2023-01-25T04:46:56.842 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2023-01-25T04:46:56.842 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2023-01-25T04:46:56.842 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.843 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2023-01-25T04:46:56.843 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2023-01-25T04:46:56.843 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.843 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2023-01-25T04:46:56.843 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.844 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2023-01-25T04:46:56.844 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.844 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2023-01-25T04:46:56.844 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.844 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2023-01-25T04:46:56.845 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2023-01-25T04:46:56.845 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.845 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2023-01-25T04:46:56.845 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2023-01-25T04:46:56.845 INFO:teuthology.orchestra.run.smithi154.stdout: debug monc = 20 2023-01-25T04:46:56.846 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2023-01-25T04:46:56.846 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2023-01-25T04:46:56.846 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = stupid 2023-01-25T04:46:56.846 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2023-01-25T04:46:56.846 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2023-01-25T04:46:56.847 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore zero block detection = True 2023-01-25T04:46:56.847 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 20 2023-01-25T04:46:56.847 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 20 2023-01-25T04:46:56.847 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-01-25T04:46:56.847 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2023-01-25T04:46:56.848 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 10 2023-01-25T04:46:56.848 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T04:46:56.848 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2023-01-25T04:46:56.848 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2023-01-25T04:46:56.848 INFO:teuthology.orchestra.run.smithi154.stdout: osd backoff on peering = True 2023-01-25T04:46:56.849 INFO:teuthology.orchestra.run.smithi154.stdout: osd blocked scrub grace period = 3600 2023-01-25T04:46:56.849 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug reject backfill probability = 0.3 2023-01-25T04:46:56.849 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify cached snaps = True 2023-01-25T04:46:56.849 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify missing on start = True 2023-01-25T04:46:56.849 INFO:teuthology.orchestra.run.smithi154.stdout: osd delete sleep = 1 2023-01-25T04:46:56.849 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2023-01-25T04:46:56.850 INFO:teuthology.orchestra.run.smithi154.stdout: osd max backfills = 3 2023-01-25T04:46:56.850 INFO:teuthology.orchestra.run.smithi154.stdout: osd max markdown count = 1000 2023-01-25T04:46:56.850 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock override recovery settings = True 2023-01-25T04:46:56.850 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2023-01-25T04:46:56.850 INFO:teuthology.orchestra.run.smithi154.stdout: osd op queue = debug_random 2023-01-25T04:46:56.851 INFO:teuthology.orchestra.run.smithi154.stdout: osd op queue cut off = debug_random 2023-01-25T04:46:56.851 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub min interval = 60 2023-01-25T04:46:56.851 INFO:teuthology.orchestra.run.smithi154.stdout: osd shutdown pgref assert = True 2023-01-25T04:46:56.851 INFO:teuthology.orchestra.run.smithi154.stdout: osd snap trim sleep = 2 2023-01-25T04:46:56.851 INFO:teuthology.orchestra.run.smithi154.stdout: osd_max_pg_log_entries = 3000 2023-01-25T04:46:56.852 INFO:teuthology.orchestra.run.smithi154.stdout: osd_min_pg_log_entries = 3000 2023-01-25T04:46:56.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.852 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2023-01-25T04:46:56.852 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-01-25T04:46:56.852 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2023-01-25T04:46:56.853 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-01-25T04:46:56.853 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-01-25T04:46:56.853 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-01-25T04:46:56.853 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-01-25T04:46:56.853 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2023-01-25T04:46:56.853 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.854 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2023-01-25T04:46:56.854 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-01-25T04:46:56.854 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-01-25T04:46:56.854 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2023-01-25T04:46:56.854 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-01-25T04:46:56.855 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2023-01-25T04:46:56.855 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2023-01-25T04:46:56.855 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-01-25T04:46:56.855 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2023-01-25T04:46:56.855 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2023-01-25T04:46:56.856 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-01-25T04:46:56.856 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.856 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T04:46:56.856 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T04:46:56.856 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T04:46:56.857 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.857 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T04:46:56.857 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T04:46:56.857 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T04:46:56.857 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.858 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2023-01-25T04:46:56.858 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2023-01-25T04:46:56.858 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.858 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2023-01-25T04:46:56.858 INFO:teuthology.orchestra.run.smithi154.stdout: mon min osdmap epochs = 50 2023-01-25T04:46:56.859 INFO:teuthology.orchestra.run.smithi154.stdout: mon osdmap full prune interval = 2 2023-01-25T04:46:56.859 INFO:teuthology.orchestra.run.smithi154.stdout: mon osdmap full prune min = 15 2023-01-25T04:46:56.859 INFO:teuthology.orchestra.run.smithi154.stdout: mon osdmap full prune txsize = 2 2023-01-25T04:46:56.859 INFO:teuthology.orchestra.run.smithi154.stdout: mon scrub interval = 300 2023-01-25T04:46:56.859 INFO:teuthology.orchestra.run.smithi154.stdout: paxos service trim min = 10 2023-01-25T04:46:56.860 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-01-25T04:46:56.860 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2023-01-25T04:46:56.860 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2023-01-25T04:46:56.860 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2023-01-25T04:46:56.860 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2023-01-25T04:46:56.861 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T04:46:56.861 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T04:46:56.861 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2023-01-25T04:46:56.861 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2023-01-25T04:46:56.861 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2023-01-25T04:46:56.862 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-25T04:46:56.862 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-25T04:46:56.924 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-25T04:46:56.925 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:56.925 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-25T04:46:56.942 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:56.942 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-25T04:46:56.998 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2023-01-25T04:46:56.998 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:56.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T04:46:56.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T04:46:57.074 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:46:57.074 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:46:57.130 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2023-01-25T04:46:57.131 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:46:57.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T04:46:57.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T04:46:57.168 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:46:57.168 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:46:57.225 INFO:tasks.ceph:Setting up mon nodes... 2023-01-25T04:46:57.225 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-25T04:46:57.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T04:46:57.279 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T04:46:57.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T04:46:57.342 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T04:46:57.345 INFO:tasks.ceph:Setting up mds nodes... 2023-01-25T04:46:57.345 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-25T04:46:57.346 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-25T04:46:57.389 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-25T04:46:57.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-25T04:46:57.445 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-25T04:46:57.458 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-25T04:46:57.459 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T04:46:57.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-25T04:46:57.485 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T04:46:57.486 INFO:tasks.ceph:role: osd.0 2023-01-25T04:46:57.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-25T04:46:57.486 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T04:46:57.559 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:46:57.560 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:46:57.560 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:46:57.560 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:46:57.560 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:46:57.561 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:46:57.561 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:46:57.561 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:46:57.561 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:46:57.561 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:46:57.991 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-01-25T04:46:57.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-25T04:46:57.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-25T04:46:58.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-25T04:46:58.205 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-25T04:46:58.272 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T04:46:58.273 INFO:tasks.ceph:role: osd.1 2023-01-25T04:46:58.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-25T04:46:58.273 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T04:46:58.346 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:46:58.347 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:46:58.347 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:46:58.347 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:46:58.347 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:46:58.347 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:46:58.348 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:46:58.348 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:46:58.348 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:46:58.348 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:46:58.772 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-01-25T04:46:58.774 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-25T04:46:58.774 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-25T04:46:58.880 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-25T04:46:58.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-25T04:46:58.977 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T04:46:58.977 INFO:tasks.ceph:role: osd.2 2023-01-25T04:46:58.977 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-25T04:46:58.978 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T04:46:59.051 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:46:59.051 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:46:59.051 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:46:59.052 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:46:59.052 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:46:59.052 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:46:59.052 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:46:59.052 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:46:59.053 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:46:59.053 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:46:59.496 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-01-25T04:46:59.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-25T04:46:59.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-25T04:46:59.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-25T04:46:59.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-25T04:46:59.758 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T04:46:59.758 INFO:tasks.ceph:role: osd.3 2023-01-25T04:46:59.759 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-25T04:46:59.759 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T04:46:59.831 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:46:59.832 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:46:59.832 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:46:59.832 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:46:59.833 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:46:59.833 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:46:59.833 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:46:59.833 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:46:59.833 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:46:59.834 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:47:00.270 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-01-25T04:47:00.271 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-25T04:47:00.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-25T04:47:00.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-25T04:47:00.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:00.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:00.582+0000 7ff3519b05c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-25T04:47:00.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:00.582+0000 7ff3519b05c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-25T04:47:00.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:00.582+0000 7ff3519b05c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T04:47:00.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:00.582+0000 7ff3519b05c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T04:47:00.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:00.582+0000 7ff3519b05c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T04:47:00.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:00.582+0000 7ff3519b05c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-25T04:47:01.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:01.108+0000 7ff3519b05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:01.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:01.873+0000 7ff3519b05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:02.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:02.638+0000 7ff3519b05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:03.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-25T04:47:03.491 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:03.579+0000 7f7c06e835c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-25T04:47:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:03.580+0000 7f7c06e835c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-25T04:47:03.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:03.580+0000 7f7c06e835c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T04:47:03.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:03.580+0000 7f7c06e835c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T04:47:03.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:03.580+0000 7f7c06e835c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T04:47:03.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:03.580+0000 7f7c06e835c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-25T04:47:04.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:04.106+0000 7f7c06e835c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:04.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:04.874+0000 7f7c06e835c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:05.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:05.640+0000 7f7c06e835c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:06.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-25T04:47:06.470 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:06.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:06.557+0000 7f1ba46ff5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-25T04:47:06.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:06.558+0000 7f1ba46ff5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-25T04:47:06.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:06.558+0000 7f1ba46ff5c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T04:47:06.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:06.558+0000 7f1ba46ff5c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T04:47:06.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:06.558+0000 7f1ba46ff5c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T04:47:06.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:06.558+0000 7f1ba46ff5c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-25T04:47:07.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:07.085+0000 7f1ba46ff5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:07.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:07.852+0000 7f1ba46ff5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:08.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:08.617+0000 7f1ba46ff5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:09.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-25T04:47:09.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:09.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:09.535+0000 7f6c721dc5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-25T04:47:09.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:09.536+0000 7f6c721dc5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-25T04:47:09.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:09.536+0000 7f6c721dc5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T04:47:09.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:09.536+0000 7f6c721dc5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T04:47:09.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:09.536+0000 7f6c721dc5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T04:47:09.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:09.536+0000 7f6c721dc5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-25T04:47:10.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:10.062+0000 7f6c721dc5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:10.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:10.827+0000 7f6c721dc5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:11.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-25T04:47:11.592+0000 7f6c721dc5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:12.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-25T04:47:12.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-25T04:47:12.456 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T04:47:12.457 INFO:tasks.ceph:role: osd.4 2023-01-25T04:47:12.457 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2023-01-25T04:47:12.457 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T04:47:12.534 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:47:12.534 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:47:12.534 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:47:12.534 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:47:12.535 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:47:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:47:12.535 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:47:12.535 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:47:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:47:12.536 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:47:12.960 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-01-25T04:47:12.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-01-25T04:47:12.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-25T04:47:13.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-25T04:47:13.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-25T04:47:13.255 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T04:47:13.256 INFO:tasks.ceph:role: osd.5 2023-01-25T04:47:13.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2023-01-25T04:47:13.256 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T04:47:13.331 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:47:13.331 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:47:13.332 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:47:13.332 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:47:13.332 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:47:13.332 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:47:13.333 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:47:13.333 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:47:13.333 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:47:13.333 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:47:13.750 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-01-25T04:47:13.752 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-01-25T04:47:13.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-25T04:47:13.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-25T04:47:13.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-25T04:47:13.968 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T04:47:13.968 INFO:tasks.ceph:role: osd.6 2023-01-25T04:47:13.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2023-01-25T04:47:13.969 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T04:47:14.043 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:47:14.043 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:47:14.043 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:47:14.044 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:47:14.044 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:47:14.044 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:47:14.044 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:47:14.045 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:47:14.045 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:47:14.045 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:47:14.488 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-01-25T04:47:14.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-01-25T04:47:14.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-25T04:47:14.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-25T04:47:14.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-25T04:47:14.774 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T04:47:14.775 INFO:tasks.ceph:role: osd.7 2023-01-25T04:47:14.775 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2023-01-25T04:47:14.775 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T04:47:14.850 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:47:14.851 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:47:14.851 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:47:14.851 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:47:14.852 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:47:14.852 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:47:14.852 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:47:14.852 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:47:14.852 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:47:14.853 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:47:15.300 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-01-25T04:47:15.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-01-25T04:47:15.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-25T04:47:15.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-25T04:47:15.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:15.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:15.618+0000 7fadd28935c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-25T04:47:15.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:15.618+0000 7fadd28935c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-25T04:47:15.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:15.618+0000 7fadd28935c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T04:47:15.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:15.618+0000 7fadd28935c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T04:47:15.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:15.618+0000 7fadd28935c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T04:47:15.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:15.619+0000 7fadd28935c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-25T04:47:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:16.144+0000 7fadd28935c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:16.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:16.914+0000 7fadd28935c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:17.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:17.679+0000 7fadd28935c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:18.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-25T04:47:18.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:18.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:18.587+0000 7fbeef6f05c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-25T04:47:18.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:18.587+0000 7fbeef6f05c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-25T04:47:18.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:18.587+0000 7fbeef6f05c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T04:47:18.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:18.587+0000 7fbeef6f05c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T04:47:18.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:18.587+0000 7fbeef6f05c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T04:47:18.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:18.588+0000 7fbeef6f05c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-25T04:47:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:19.118+0000 7fbeef6f05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:19.882+0000 7fbeef6f05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:20.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:20.647+0000 7fbeef6f05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:21.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-25T04:47:21.485 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:21.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:21.576+0000 7f0f80fe05c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-25T04:47:21.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:21.576+0000 7f0f80fe05c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-25T04:47:21.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:21.576+0000 7f0f80fe05c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T04:47:21.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:21.576+0000 7f0f80fe05c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T04:47:21.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:21.576+0000 7f0f80fe05c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T04:47:21.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:21.576+0000 7f0f80fe05c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-01-25T04:47:22.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:22.109+0000 7f0f80fe05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:22.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:22.876+0000 7f0f80fe05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:23.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:23.640+0000 7f0f80fe05c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:24.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-25T04:47:24.471 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:24.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:24.560+0000 7f442b2cf5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-25T04:47:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:24.561+0000 7f442b2cf5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-25T04:47:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:24.561+0000 7f442b2cf5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T04:47:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:24.561+0000 7f442b2cf5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T04:47:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:24.561+0000 7f442b2cf5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T04:47:24.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:24.561+0000 7f442b2cf5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-01-25T04:47:25.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:25.087+0000 7f442b2cf5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:25.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:25.852+0000 7f442b2cf5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:26.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-01-25T04:47:26.621+0000 7f442b2cf5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:47:27.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-25T04:47:27.461 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-25T04:47:27.462 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:27.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-25T04:47:27.494 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:27.495 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-25T04:47:27.565 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:27.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-25T04:47:27.635 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:27.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-25T04:47:27.704 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:27.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-25T04:47:27.772 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:27.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-25T04:47:27.805 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:27.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-25T04:47:27.875 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:27.876 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-25T04:47:27.945 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:27.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-25T04:47:28.012 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:28.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-25T04:47:28.080 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:28.081 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-25T04:47:28.100 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:28.100 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-25T04:47:28.138 INFO:tasks.ceph:Adding keys to all mons... 2023-01-25T04:47:28.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T04:47:28.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T04:47:28.181 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2023-01-25T04:47:28.181 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBBtNBj8ZqlEBAAtzeXRAZqq9tZnQCb1eHb3w== 2023-01-25T04:47:28.182 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2023-01-25T04:47:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBEtNBjsC7EIhAAkrMpsqlGTlybZ7ST0FkRFQ== 2023-01-25T04:47:28.182 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2023-01-25T04:47:28.182 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBHtNBjj36gIhAAYlhzJoWGImOgVHlBoKqUyA== 2023-01-25T04:47:28.182 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2023-01-25T04:47:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBKtNBjNTdRIRAAbAZaSACLm1zv7EaoJAMh7A== 2023-01-25T04:47:28.183 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2023-01-25T04:47:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBNtNBj1kj/HxAAJSj1dwFfBg0/nwauu1evTw== 2023-01-25T04:47:28.183 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2023-01-25T04:47:28.183 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBBtNBjIIdkFBAAj1ktSw6GqpeoTErNVu2pJg== 2023-01-25T04:47:28.184 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2023-01-25T04:47:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBTtNBjGjHiJBAAb+Szxi+qAwsjMkVoQqb+tA== 2023-01-25T04:47:28.184 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2023-01-25T04:47:28.184 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBWtNBjQLgJIxAAVVclBsX4h85K91asO1UiIQ== 2023-01-25T04:47:28.184 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2023-01-25T04:47:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBZtNBje+BaIhAAQa27/IF04+RXKtzP7IwQ6w== 2023-01-25T04:47:28.185 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2023-01-25T04:47:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBctNBjq3WBIRAAqSkJ7VYwi/h8ymIbck43ug== 2023-01-25T04:47:28.185 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-01-25T04:47:28.185 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBBtNBjlc4xFxAA+arWNgvkRaQf6RP8ZOpvWw== 2023-01-25T04:47:28.185 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2023-01-25T04:47:28.186 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBBtNBjeYmMGhAArK4rSEAZFEhVkfESeaZ3ZA== 2023-01-25T04:47:28.205 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2023-01-25T04:47:28.206 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBBtNBj8ZqlEBAAtzeXRAZqq9tZnQCb1eHb3w== 2023-01-25T04:47:28.206 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2023-01-25T04:47:28.206 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBEtNBjsC7EIhAAkrMpsqlGTlybZ7ST0FkRFQ== 2023-01-25T04:47:28.206 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2023-01-25T04:47:28.206 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBHtNBjj36gIhAAYlhzJoWGImOgVHlBoKqUyA== 2023-01-25T04:47:28.207 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2023-01-25T04:47:28.207 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBKtNBjNTdRIRAAbAZaSACLm1zv7EaoJAMh7A== 2023-01-25T04:47:28.207 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2023-01-25T04:47:28.207 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBNtNBj1kj/HxAAJSj1dwFfBg0/nwauu1evTw== 2023-01-25T04:47:28.207 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2023-01-25T04:47:28.208 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBBtNBjIIdkFBAAj1ktSw6GqpeoTErNVu2pJg== 2023-01-25T04:47:28.208 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2023-01-25T04:47:28.208 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBTtNBjGjHiJBAAb+Szxi+qAwsjMkVoQqb+tA== 2023-01-25T04:47:28.208 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2023-01-25T04:47:28.209 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBWtNBjQLgJIxAAVVclBsX4h85K91asO1UiIQ== 2023-01-25T04:47:28.209 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2023-01-25T04:47:28.209 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBZtNBje+BaIhAAQa27/IF04+RXKtzP7IwQ6w== 2023-01-25T04:47:28.209 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2023-01-25T04:47:28.209 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBctNBjq3WBIRAAqSkJ7VYwi/h8ymIbck43ug== 2023-01-25T04:47:28.210 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2023-01-25T04:47:28.210 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBBtNBjlc4xFxAA+arWNgvkRaQf6RP8ZOpvWw== 2023-01-25T04:47:28.210 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2023-01-25T04:47:28.210 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBBtNBjeYmMGhAArK4rSEAZFEhVkfESeaZ3ZA== 2023-01-25T04:47:28.211 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T04:47:28.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T04:47:28.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.471 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.473 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T04:47:28.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T04:47:28.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.694 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.746 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:47:28.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T04:47:28.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T04:47:28.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T04:47:28.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T04:47:28.918 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-25T04:47:28.918 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-25T04:47:28.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T04:47:29.042 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-25T04:47:29.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-25T04:47:29.134 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T04:47:29.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-25T04:47:29.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-25T04:47:29.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T04:47:29.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-25T04:47:29.408 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:29.411 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:47:29.465 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-25T04:47:29.465 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-25T04:47:29.466 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-25T04:47:29.468 INFO:tasks.ceph.mon.a:Started 2023-01-25T04:47:29.468 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-25T04:47:29.469 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-25T04:47:29.471 INFO:tasks.ceph.mon.c:Started 2023-01-25T04:47:29.471 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-25T04:47:29.471 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-25T04:47:29.507 INFO:tasks.ceph.mon.b:Started 2023-01-25T04:47:29.508 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-25T04:47:29.508 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-25T04:47:29.510 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-25T04:47:29.512 INFO:tasks.ceph.mgr.y:Started 2023-01-25T04:47:29.512 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-25T04:47:29.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-25T04:47:29.515 INFO:tasks.ceph.mgr.x:Started 2023-01-25T04:47:29.515 INFO:tasks.ceph:Setting crush tunables to default 2023-01-25T04:47:29.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd crush tunables default 2023-01-25T04:47:35.924 INFO:teuthology.orchestra.run.smithi149.stderr:adjusted tunables profile to default 2023-01-25T04:47:35.936 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-25T04:47:35.937 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:35.937 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-25T04:47:35.954 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:35.954+0000 7fa6beb3c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T04:47:35.963 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:35.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-25T04:47:36.021 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:36.021+0000 7fa6beb3c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T04:47:36.029 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:36.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-25T04:47:36.095 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-25T04:47:36.095 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-25T04:47:36.099 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:36.099+0000 7fa6beb3c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T04:47:36.125 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:36.125 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-25T04:47:36.157 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:36.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-25T04:47:36.182 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:36.182+0000 7fa6beb3c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T04:47:36.227 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:36.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-25T04:47:36.295 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-01-25T04:47:36.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-25T04:47:36.322 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:36.320+0000 7fe543666200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T04:47:36.324 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:36.324+0000 7fa6beb3c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T04:47:36.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 50ebe746-cf24-467b-8507-327fde9bf001 0 2023-01-25T04:47:36.389 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:36.387+0000 7fe543666200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T04:47:36.466 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:36.465+0000 7fe543666200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T04:47:36.550 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:36.548+0000 7fe543666200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T04:47:36.606 INFO:teuthology.orchestra.run.smithi154.stdout:0 2023-01-25T04:47:36.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 65a94fff-022e-4590-88c7-29a290231bcb 1 2023-01-25T04:47:36.671 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:36.671+0000 7fa6beb3c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T04:47:36.700 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:36.698+0000 7fe543666200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T04:47:36.745 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:36.744+0000 7fa6beb3c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T04:47:36.840 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-01-25T04:47:36.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 599c8478-1fcc-4770-9383-2c442608a44b 2 2023-01-25T04:47:36.874 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:36.874+0000 7fa6beb3c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T04:47:36.954 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:36.954+0000 7fa6beb3c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T04:47:37.056 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:37.054+0000 7fe543666200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T04:47:37.074 INFO:teuthology.orchestra.run.smithi154.stdout:2 2023-01-25T04:47:37.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new b5a89885-d861-4689-a1ea-bc4095a71cba 3 2023-01-25T04:47:37.135 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:37.133+0000 7fe543666200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T04:47:37.262 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:37.261+0000 7fe543666200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T04:47:37.309 INFO:teuthology.orchestra.run.smithi154.stdout:3 2023-01-25T04:47:37.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 4eed053d-6485-4517-8623-6338721d0f2c 4 2023-01-25T04:47:37.346 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:37.344+0000 7fe543666200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T04:47:37.393 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:37.392+0000 7fa6beb3c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T04:47:37.542 INFO:teuthology.orchestra.run.smithi154.stdout:4 2023-01-25T04:47:37.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 227f35a6-fcaa-4265-a9ee-01ec1b98bb6f 5 2023-01-25T04:47:37.835 INFO:teuthology.orchestra.run.smithi154.stdout:5 2023-01-25T04:47:37.836 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:37.835+0000 7fe543666200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T04:47:37.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 52339049-79dd-49c4-acd0-ca38ed7ccf99 6 2023-01-25T04:47:37.943 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:37.942+0000 7fa6beb3c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T04:47:38.069 INFO:teuthology.orchestra.run.smithi154.stdout:6 2023-01-25T04:47:38.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 4c7d0cef-7d24-4cb3-b21d-5e246dbd7a8c 7 2023-01-25T04:47:38.103 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:38.102+0000 7fa6beb3c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T04:47:38.338 INFO:teuthology.orchestra.run.smithi154.stdout:7 2023-01-25T04:47:38.350 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-25T04:47:38.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-25T04:47:38.353 INFO:tasks.ceph.osd.0:Started 2023-01-25T04:47:38.353 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-25T04:47:38.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-25T04:47:38.355 INFO:tasks.ceph.osd.1:Started 2023-01-25T04:47:38.356 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-25T04:47:38.356 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-25T04:47:38.358 INFO:tasks.ceph.osd.2:Started 2023-01-25T04:47:38.358 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-25T04:47:38.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-25T04:47:38.361 INFO:tasks.ceph.osd.3:Started 2023-01-25T04:47:38.361 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-25T04:47:38.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-25T04:47:38.364 INFO:tasks.ceph.osd.4:Started 2023-01-25T04:47:38.364 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-25T04:47:38.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-25T04:47:38.367 INFO:tasks.ceph.osd.5:Started 2023-01-25T04:47:38.367 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-25T04:47:38.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-25T04:47:38.369 INFO:tasks.ceph.osd.6:Started 2023-01-25T04:47:38.370 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-25T04:47:38.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-25T04:47:38.372 INFO:tasks.ceph.osd.7:Started 2023-01-25T04:47:38.373 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T04:47:38.441 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:38.440+0000 7fe543666200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T04:47:38.607 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:38.605+0000 7fe543666200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T04:47:38.613 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:38.613 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":10,"fsid":"629f2296-7568-47e9-b1d7-daec4aeb5f55","created":"2023-01-25T04:47:35.793813+0000","modified":"2023-01-25T04:47:38.333032+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T04:47:38.333032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"50ebe746-cf24-467b-8507-327fde9bf001","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"65a94fff-022e-4590-88c7-29a290231bcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"599c8478-1fcc-4770-9383-2c442608a44b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5a89885-d861-4689-a1ea-bc4095a71cba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4eed053d-6485-4517-8623-6338721d0f2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"227f35a6-fcaa-4265-a9ee-01ec1b98bb6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52339049-79dd-49c4-acd0-ca38ed7ccf99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c7d0cef-7d24-4cb3-b21d-5e246dbd7a8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:47:38.627 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-25T04:47:38.627 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-25T04:47:38.825 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:38.824+0000 7fa6beb3c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T04:47:38.901 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:38.900+0000 7fa6beb3c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T04:47:38.978 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-01-25T04:47:38.976+0000 7f640b4af5c0 -1 Falling back to public interface 2023-01-25T04:47:38.980 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-01-25T04:47:38.978+0000 7f52adf735c0 -1 Falling back to public interface 2023-01-25T04:47:38.981 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-01-25T04:47:38.979+0000 7f5e85e0d5c0 -1 Falling back to public interface 2023-01-25T04:47:38.985 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-01-25T04:47:38.984+0000 7fd9b78fe5c0 -1 Falling back to public interface 2023-01-25T04:47:38.987 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-01-25T04:47:38.986+0000 7f7feb3065c0 -1 Falling back to public interface 2023-01-25T04:47:38.988 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-01-25T04:47:38.986+0000 7f93ed1dc5c0 -1 Falling back to public interface 2023-01-25T04:47:38.992 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-01-25T04:47:38.990+0000 7fb7f8ddf5c0 -1 Falling back to public interface 2023-01-25T04:47:39.007 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-01-25T04:47:39.006+0000 7f92b58285c0 -1 Falling back to public interface 2023-01-25T04:47:39.042 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:39.040+0000 7fa6beb3c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T04:47:39.197 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:39.196+0000 7fa6beb3c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T04:47:39.290 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:39.288+0000 7fe543666200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T04:47:39.329 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:39.327+0000 7fa6beb3c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T04:47:39.365 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:39.364+0000 7fe543666200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T04:47:39.432 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T04:47:39.502 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:39.500+0000 7fe543666200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T04:47:39.662 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:39.660+0000 7fe543666200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T04:47:39.693 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:39.692+0000 7fa6beb3c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T04:47:39.755 INFO:teuthology.misc.health.smithi149.stderr:2023-01-25T04:47:39.754+0000 7fe5ee7fc700 0 --2- 172.21.15.149:0/4231376238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5f013ca00 0x7fe5f013d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-01-25T04:47:39.793 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:39.792+0000 7fe543666200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T04:47:39.833 INFO:teuthology.misc.health.smithi149.stdout: 2023-01-25T04:47:39.833 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":10,"fsid":"629f2296-7568-47e9-b1d7-daec4aeb5f55","created":"2023-01-25T04:47:35.793813+0000","modified":"2023-01-25T04:47:38.333032+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T04:47:38.333032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"50ebe746-cf24-467b-8507-327fde9bf001","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"65a94fff-022e-4590-88c7-29a290231bcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"599c8478-1fcc-4770-9383-2c442608a44b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5a89885-d861-4689-a1ea-bc4095a71cba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4eed053d-6485-4517-8623-6338721d0f2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"227f35a6-fcaa-4265-a9ee-01ec1b98bb6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52339049-79dd-49c4-acd0-ca38ed7ccf99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c7d0cef-7d24-4cb3-b21d-5e246dbd7a8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:47:39.845 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-25T04:47:39.849 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:39.847+0000 7fa6beb3c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T04:47:39.964 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:39.962+0000 7fa6beb3c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T04:47:40.111 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:40.109+0000 7fa6beb3c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T04:47:40.149 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:40.147+0000 7fe543666200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T04:47:40.208 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:40.207+0000 7fa6beb3c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T04:47:40.300 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:40.298+0000 7fe543666200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T04:47:40.416 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:40.414+0000 7fe543666200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T04:47:40.563 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:40.562+0000 7fe543666200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T04:47:40.570 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:40.569+0000 7fa6beb3c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T04:47:40.663 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:40.662+0000 7fe543666200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T04:47:41.020 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:41.019+0000 7fe543666200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T04:47:41.148 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:41.147+0000 7fa6beb3c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T04:47:41.616 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-01-25T04:47:41.614+0000 7fe543666200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T04:47:42.176 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:42.174+0000 7fa676ef6700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-25T04:47:42.178 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-01-25T04:47:42.177+0000 7fa676ef6700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-25T04:47:42.472 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-01-25T04:47:42.471+0000 7f640b4af5c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:47:42.496 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-01-25T04:47:42.494+0000 7f93ed1dc5c0 -1 osd.7 0 log_to_monitors true 2023-01-25T04:47:42.503 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-01-25T04:47:42.502+0000 7fd9b78fe5c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:47:42.511 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-01-25T04:47:42.510+0000 7f7feb3065c0 -1 osd.2 0 log_to_monitors true 2023-01-25T04:47:42.514 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-01-25T04:47:42.513+0000 7f92b58285c0 -1 osd.3 0 log_to_monitors true 2023-01-25T04:47:42.518 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-01-25T04:47:42.517+0000 7f5e85e0d5c0 -1 osd.4 0 log_to_monitors true 2023-01-25T04:47:42.523 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-01-25T04:47:42.522+0000 7f52adf735c0 -1 osd.5 0 log_to_monitors true 2023-01-25T04:47:42.531 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-01-25T04:47:42.529+0000 7fb7f8ddf5c0 -1 osd.6 0 log_to_monitors true 2023-01-25T04:47:44.178 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-01-25T04:47:44.177+0000 7f7fdeebd700 -1 osd.2 0 waiting for initial osdmap 2023-01-25T04:47:44.182 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-01-25T04:47:44.181+0000 7fb7ec996700 -1 osd.6 0 waiting for initial osdmap 2023-01-25T04:47:44.183 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-01-25T04:47:44.182+0000 7f52a1b2a700 -1 osd.5 0 waiting for initial osdmap 2023-01-25T04:47:44.184 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-01-25T04:47:44.182+0000 7f93e0d93700 -1 osd.7 0 waiting for initial osdmap 2023-01-25T04:47:44.185 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-01-25T04:47:44.184+0000 7f63ff066700 -1 osd.0 0 waiting for initial osdmap 2023-01-25T04:47:44.186 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-01-25T04:47:44.185+0000 7fd9ab4b5700 -1 osd.1 0 waiting for initial osdmap 2023-01-25T04:47:44.187 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-01-25T04:47:44.185+0000 7f5e799c4700 -1 osd.4 0 waiting for initial osdmap 2023-01-25T04:47:44.187 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-01-25T04:47:44.185+0000 7f92a93df700 -1 osd.3 0 waiting for initial osdmap 2023-01-25T04:47:44.187 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-01-25T04:47:44.186+0000 7f7fda29e700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:47:44.188 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-01-25T04:47:44.186+0000 7fb7e7d77700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:47:44.189 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-01-25T04:47:44.187+0000 7f529cf0b700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:47:44.189 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-01-25T04:47:44.187+0000 7f93dc174700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:47:44.189 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-01-25T04:47:44.188+0000 7f63fa447700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:47:44.190 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-01-25T04:47:44.189+0000 7f5e74da5700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:47:44.191 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-01-25T04:47:44.190+0000 7fd9a6896700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:47:44.194 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-01-25T04:47:44.193+0000 7f92a47c0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:47:46.651 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T04:47:46.981 INFO:teuthology.misc.health.smithi149.stderr:2023-01-25T04:47:46.980+0000 7f93927fc700 0 --2- 172.21.15.149:0/2971765879 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f939413f2c0 0x7f93941d7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-01-25T04:47:47.176 INFO:teuthology.misc.health.smithi149.stdout: 2023-01-25T04:47:47.176 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":14,"fsid":"629f2296-7568-47e9-b1d7-daec4aeb5f55","created":"2023-01-25T04:47:35.793813+0000","modified":"2023-01-25T04:47:46.178558+0000","last_up_change":"2023-01-25T04:47:45.176604+0000","last_in_change":"2023-01-25T04:47:38.333032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T04:47:45.219309+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"50ebe746-cf24-467b-8507-327fde9bf001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":93008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":93008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":93008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":93008}]},"public_addr":"172.21.15.149:6800/93008","cluster_addr":"172.21.15.149:6801/93008","heartbeat_back_addr":"172.21.15.149:6803/93008","heartbeat_front_addr":"172.21.15.149:6802/93008","state":["exists","up"]},{"osd":1,"uuid":"65a94fff-022e-4590-88c7-29a290231bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":93009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":93009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6807","nonce":93009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":93009}]},"public_addr":"172.21.15.149:6804/93009","cluster_addr":"172.21.15.149:6805/93009","heartbeat_back_addr":"172.21.15.149:6807/93009","heartbeat_front_addr":"172.21.15.149:6806/93009","state":["exists","up"]},{"osd":2,"uuid":"599c8478-1fcc-4770-9383-2c442608a44b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":93018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":93018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":93018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":93018}]},"public_addr":"172.21.15.149:6808/93018","cluster_addr":"172.21.15.149:6809/93018","heartbeat_back_addr":"172.21.15.149:6811/93018","heartbeat_front_addr":"172.21.15.149:6810/93018","state":["exists","up"]},{"osd":3,"uuid":"b5a89885-d861-4689-a1ea-bc4095a71cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":93019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6813","nonce":93019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":93019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":93019}]},"public_addr":"172.21.15.149:6812/93019","cluster_addr":"172.21.15.149:6813/93019","heartbeat_back_addr":"172.21.15.149:6815/93019","heartbeat_front_addr":"172.21.15.149:6814/93019","state":["exists","up"]},{"osd":4,"uuid":"4eed053d-6485-4517-8623-6338721d0f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":92973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":92973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":92973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":92973}]},"public_addr":"172.21.15.154:6804/92973","cluster_addr":"172.21.15.154:6805/92973","heartbeat_back_addr":"172.21.15.154:6807/92973","heartbeat_front_addr":"172.21.15.154:6806/92973","state":["exists","up"]},{"osd":5,"uuid":"227f35a6-fcaa-4265-a9ee-01ec1b98bb6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":92974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6801","nonce":92974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":92974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":92974}]},"public_addr":"172.21.15.154:6800/92974","cluster_addr":"172.21.15.154:6801/92974","heartbeat_back_addr":"172.21.15.154:6803/92974","heartbeat_front_addr":"172.21.15.154:6802/92974","state":["exists","up"]},{"osd":6,"uuid":"52339049-79dd-49c4-acd0-ca38ed7ccf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":92998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":92998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":92998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":92998}]},"public_addr":"172.21.15.154:6812/92998","cluster_addr":"172.21.15.154:6813/92998","heartbeat_back_addr":"172.21.15.154:6815/92998","heartbeat_front_addr":"172.21.15.154:6814/92998","state":["exists","up"]},{"osd":7,"uuid":"4c7d0cef-7d24-4cb3-b21d-5e246dbd7a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":92984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":92984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":92984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":92984}]},"public_addr":"172.21.15.154:6808/92984","cluster_addr":"172.21.15.154:6809/92984","heartbeat_back_addr":"172.21.15.154:6811/92984","heartbeat_front_addr":"172.21.15.154:6810/92984","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.471691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.510295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.508700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.500134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.472805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.492966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.497715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.484417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:47:47.190 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-25T04:47:47.190 INFO:tasks.ceph:Creating RBD pool 2023-01-25T04:47:47.190 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-25T04:47:48.214 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'rbd' created 2023-01-25T04:47:48.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-25T04:47:49.221 INFO:teuthology.orchestra.run.smithi149.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-25T04:47:49.235 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-25T04:47:49.236 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-25T04:47:49.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-25T04:47:49.237 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-25T04:47:49.237 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-25T04:47:49.621 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:49.634 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":5,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":92736}]},"active_addr":"172.21.15.149:6816/92736","active_change":"2023-01-25T04:47:41.161511+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":4053927683}]},{"addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":3746747163}]},{"addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":1406272362}]},{"addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":3856201670}]}]}} 2023-01-25T04:47:49.638 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-25T04:47:49.639 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-25T04:47:49.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T04:47:49.956 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:49.956 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"fsid":"629f2296-7568-47e9-b1d7-daec4aeb5f55","created":"2023-01-25T04:47:35.793813+0000","modified":"2023-01-25T04:47:49.203335+0000","last_up_change":"2023-01-25T04:47:45.176604+0000","last_in_change":"2023-01-25T04:47:38.333032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T04:47:45.219309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-25T04:47:47.525179+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"50ebe746-cf24-467b-8507-327fde9bf001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":93008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":93008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":93008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":93008}]},"public_addr":"172.21.15.149:6800/93008","cluster_addr":"172.21.15.149:6801/93008","heartbeat_back_addr":"172.21.15.149:6803/93008","heartbeat_front_addr":"172.21.15.149:6802/93008","state":["exists","up"]},{"osd":1,"uuid":"65a94fff-022e-4590-88c7-29a290231bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":93009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":93009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6807","nonce":93009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":93009}]},"public_addr":"172.21.15.149:6804/93009","cluster_addr":"172.21.15.149:6805/93009","heartbeat_back_addr":"172.21.15.149:6807/93009","heartbeat_front_addr":"172.21.15.149:6806/93009","state":["exists","up"]},{"osd":2,"uuid":"599c8478-1fcc-4770-9383-2c442608a44b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":93018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":93018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":93018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":93018}]},"public_addr":"172.21.15.149:6808/93018","cluster_addr":"172.21.15.149:6809/93018","heartbeat_back_addr":"172.21.15.149:6811/93018","heartbeat_front_addr":"172.21.15.149:6810/93018","state":["exists","up"]},{"osd":3,"uuid":"b5a89885-d861-4689-a1ea-bc4095a71cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":93019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6813","nonce":93019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":93019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":93019}]},"public_addr":"172.21.15.149:6812/93019","cluster_addr":"172.21.15.149:6813/93019","heartbeat_back_addr":"172.21.15.149:6815/93019","heartbeat_front_addr":"172.21.15.149:6814/93019","state":["exists","up"]},{"osd":4,"uuid":"4eed053d-6485-4517-8623-6338721d0f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":92973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":92973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":92973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":92973}]},"public_addr":"172.21.15.154:6804/92973","cluster_addr":"172.21.15.154:6805/92973","heartbeat_back_addr":"172.21.15.154:6807/92973","heartbeat_front_addr":"172.21.15.154:6806/92973","state":["exists","up"]},{"osd":5,"uuid":"227f35a6-fcaa-4265-a9ee-01ec1b98bb6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":92974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6801","nonce":92974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":92974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":92974}]},"public_addr":"172.21.15.154:6800/92974","cluster_addr":"172.21.15.154:6801/92974","heartbeat_back_addr":"172.21.15.154:6803/92974","heartbeat_front_addr":"172.21.15.154:6802/92974","state":["exists","up"]},{"osd":6,"uuid":"52339049-79dd-49c4-acd0-ca38ed7ccf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":92998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":92998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":92998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":92998}]},"public_addr":"172.21.15.154:6812/92998","cluster_addr":"172.21.15.154:6813/92998","heartbeat_back_addr":"172.21.15.154:6815/92998","heartbeat_front_addr":"172.21.15.154:6814/92998","state":["exists","up"]},{"osd":7,"uuid":"4c7d0cef-7d24-4cb3-b21d-5e246dbd7a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":92984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":92984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":92984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":92984}]},"public_addr":"172.21.15.154:6808/92984","cluster_addr":"172.21.15.154:6809/92984","heartbeat_back_addr":"172.21.15.154:6811/92984","heartbeat_front_addr":"172.21.15.154:6810/92984","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.471691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.510295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.508700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.500134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.472805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.492966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.497715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.484417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:47:49.970 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-25T04:47:49.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T04:47:50.292 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:50.292 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":18,"fsid":"629f2296-7568-47e9-b1d7-daec4aeb5f55","created":"2023-01-25T04:47:35.793813+0000","modified":"2023-01-25T04:47:50.209414+0000","last_up_change":"2023-01-25T04:47:45.176604+0000","last_in_change":"2023-01-25T04:47:38.333032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T04:47:45.219309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-25T04:47:47.525179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"50ebe746-cf24-467b-8507-327fde9bf001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":93008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":93008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6803","nonce":93008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":93008}]},"public_addr":"172.21.15.149:6800/93008","cluster_addr":"172.21.15.149:6801/93008","heartbeat_back_addr":"172.21.15.149:6803/93008","heartbeat_front_addr":"172.21.15.149:6802/93008","state":["exists","up"]},{"osd":1,"uuid":"65a94fff-022e-4590-88c7-29a290231bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":93009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":93009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6807","nonce":93009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":93009}]},"public_addr":"172.21.15.149:6804/93009","cluster_addr":"172.21.15.149:6805/93009","heartbeat_back_addr":"172.21.15.149:6807/93009","heartbeat_front_addr":"172.21.15.149:6806/93009","state":["exists","up"]},{"osd":2,"uuid":"599c8478-1fcc-4770-9383-2c442608a44b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":93018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6809","nonce":93018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":93018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":93018}]},"public_addr":"172.21.15.149:6808/93018","cluster_addr":"172.21.15.149:6809/93018","heartbeat_back_addr":"172.21.15.149:6811/93018","heartbeat_front_addr":"172.21.15.149:6810/93018","state":["exists","up"]},{"osd":3,"uuid":"b5a89885-d861-4689-a1ea-bc4095a71cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":93019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6813","nonce":93019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":93019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":93019}]},"public_addr":"172.21.15.149:6812/93019","cluster_addr":"172.21.15.149:6813/93019","heartbeat_back_addr":"172.21.15.149:6815/93019","heartbeat_front_addr":"172.21.15.149:6814/93019","state":["exists","up"]},{"osd":4,"uuid":"4eed053d-6485-4517-8623-6338721d0f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":92973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6805","nonce":92973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6807","nonce":92973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":92973}]},"public_addr":"172.21.15.154:6804/92973","cluster_addr":"172.21.15.154:6805/92973","heartbeat_back_addr":"172.21.15.154:6807/92973","heartbeat_front_addr":"172.21.15.154:6806/92973","state":["exists","up"]},{"osd":5,"uuid":"227f35a6-fcaa-4265-a9ee-01ec1b98bb6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":92974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6801","nonce":92974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6803","nonce":92974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":92974}]},"public_addr":"172.21.15.154:6800/92974","cluster_addr":"172.21.15.154:6801/92974","heartbeat_back_addr":"172.21.15.154:6803/92974","heartbeat_front_addr":"172.21.15.154:6802/92974","state":["exists","up"]},{"osd":6,"uuid":"52339049-79dd-49c4-acd0-ca38ed7ccf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":92998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":92998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":92998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":92998}]},"public_addr":"172.21.15.154:6812/92998","cluster_addr":"172.21.15.154:6813/92998","heartbeat_back_addr":"172.21.15.154:6815/92998","heartbeat_front_addr":"172.21.15.154:6814/92998","state":["exists","up"]},{"osd":7,"uuid":"4c7d0cef-7d24-4cb3-b21d-5e246dbd7a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":92984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":92984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":92984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":92984}]},"public_addr":"172.21.15.154:6808/92984","cluster_addr":"172.21.15.154:6809/92984","heartbeat_back_addr":"172.21.15.154:6811/92984","heartbeat_front_addr":"172.21.15.154:6810/92984","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.471691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.510295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.508700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.500134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.472805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.492966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.497715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:47:43.484417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:47:50.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-25T04:47:50.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-25T04:47:50.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-25T04:47:50.308 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-25T04:47:50.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-25T04:47:50.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-25T04:47:50.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-25T04:47:50.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-25T04:47:50.602 INFO:teuthology.orchestra.run.smithi149.stdout:55834574852 2023-01-25T04:47:50.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T04:47:50.606 INFO:teuthology.orchestra.run.smithi149.stdout:55834574852 2023-01-25T04:47:50.606 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T04:47:50.608 INFO:teuthology.orchestra.run.smithi149.stdout:55834574850 2023-01-25T04:47:50.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T04:47:50.618 INFO:teuthology.orchestra.run.smithi149.stdout:55834574851 2023-01-25T04:47:50.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T04:47:50.625 INFO:teuthology.orchestra.run.smithi149.stdout:55834574850 2023-01-25T04:47:50.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T04:47:50.629 INFO:teuthology.orchestra.run.smithi149.stdout:55834574852 2023-01-25T04:47:50.630 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T04:47:50.668 INFO:teuthology.orchestra.run.smithi149.stdout:55834574851 2023-01-25T04:47:50.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T04:47:50.693 INFO:teuthology.orchestra.run.smithi149.stdout:55834574852 2023-01-25T04:47:50.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T04:47:51.216 INFO:teuthology.orchestra.run.smithi149.stdout:55834574849 2023-01-25T04:47:51.227 INFO:teuthology.orchestra.run.smithi149.stdout:55834574850 2023-01-25T04:47:51.235 INFO:teuthology.orchestra.run.smithi149.stdout:55834574850 2023-01-25T04:47:51.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.4 2023-01-25T04:47:51.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.3 2023-01-25T04:47:51.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.5 2023-01-25T04:47:51.264 INFO:teuthology.orchestra.run.smithi149.stdout:55834574849 2023-01-25T04:47:51.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574849 for osd.0 2023-01-25T04:47:51.309 INFO:teuthology.orchestra.run.smithi149.stdout:55834574849 2023-01-25T04:47:51.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.2 2023-01-25T04:47:51.332 INFO:teuthology.orchestra.run.smithi149.stdout:55834574850 2023-01-25T04:47:51.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.6 2023-01-25T04:47:51.354 INFO:teuthology.orchestra.run.smithi149.stdout:55834574849 2023-01-25T04:47:51.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574849 for osd.7 2023-01-25T04:47:51.389 INFO:teuthology.orchestra.run.smithi149.stdout:55834574850 2023-01-25T04:47:51.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.1 2023-01-25T04:47:52.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T04:47:52.261 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T04:47:52.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T04:47:52.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T04:47:52.325 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T04:47:52.347 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T04:47:52.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T04:47:52.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T04:47:52.841 INFO:teuthology.orchestra.run.smithi149.stdout:55834574852 2023-01-25T04:47:52.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2023-01-25T04:47:52.862 DEBUG:teuthology.parallel:result is None 2023-01-25T04:47:52.866 INFO:teuthology.orchestra.run.smithi149.stdout:55834574852 2023-01-25T04:47:52.888 INFO:teuthology.orchestra.run.smithi149.stdout:55834574851 2023-01-25T04:47:52.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2023-01-25T04:47:52.894 DEBUG:teuthology.parallel:result is None 2023-01-25T04:47:52.896 INFO:teuthology.orchestra.run.smithi149.stdout:55834574850 2023-01-25T04:47:52.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2023-01-25T04:47:52.906 DEBUG:teuthology.parallel:result is None 2023-01-25T04:47:52.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.5 2023-01-25T04:47:52.920 DEBUG:teuthology.parallel:result is None 2023-01-25T04:47:52.960 INFO:teuthology.orchestra.run.smithi149.stdout:55834574851 2023-01-25T04:47:52.964 INFO:teuthology.orchestra.run.smithi149.stdout:55834574850 2023-01-25T04:47:52.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.2 2023-01-25T04:47:52.981 DEBUG:teuthology.parallel:result is None 2023-01-25T04:47:52.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2023-01-25T04:47:52.982 DEBUG:teuthology.parallel:result is None 2023-01-25T04:47:52.996 INFO:teuthology.orchestra.run.smithi149.stdout:55834574852 2023-01-25T04:47:53.008 INFO:teuthology.orchestra.run.smithi149.stdout:55834574852 2023-01-25T04:47:53.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2023-01-25T04:47:53.011 DEBUG:teuthology.parallel:result is None 2023-01-25T04:47:53.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2023-01-25T04:47:53.024 DEBUG:teuthology.parallel:result is None 2023-01-25T04:47:53.024 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T04:47:53.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T04:47:53.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:53.383 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-01-25T04:47:53.395 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2023-01-25T04:47:53.170562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":43512,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":40256,"kb_avail":754931208,"statfs":{"total":773094113280,"available":773049556992,"internally_reserved":0,"allocated":2420736,"data_stored":1588809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41222144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.954494"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.234962+0000","last_change":"2023-01-25T04:47:49.227848+0000","last_active":"2023-01-25T04:47:49.234962+0000","last_peered":"2023-01-25T04:47:49.234962+0000","last_clean":"2023-01-25T04:47:49.234962+0000","last_became_active":"2023-01-25T04:47:49.227478+0000","last_became_peered":"2023-01-25T04:47:49.227478+0000","last_unstale":"2023-01-25T04:47:49.234962+0000","last_undegraded":"2023-01-25T04:47:49.234962+0000","last_fullsized":"2023-01-25T04:47:49.234962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:04.022357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.195287+0000","last_change":"2023-01-25T04:47:49.228105+0000","last_active":"2023-01-25T04:47:50.195287+0000","last_peered":"2023-01-25T04:47:50.195287+0000","last_clean":"2023-01-25T04:47:50.195287+0000","last_became_active":"2023-01-25T04:47:49.227485+0000","last_became_peered":"2023-01-25T04:47:49.227485+0000","last_unstale":"2023-01-25T04:47:50.195287+0000","last_undegraded":"2023-01-25T04:47:50.195287+0000","last_fullsized":"2023-01-25T04:47:50.195287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:05.231608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.234940+0000","last_change":"2023-01-25T04:47:49.231399+0000","last_active":"2023-01-25T04:47:49.234940+0000","last_peered":"2023-01-25T04:47:49.234940+0000","last_clean":"2023-01-25T04:47:49.234940+0000","last_became_active":"2023-01-25T04:47:49.231045+0000","last_became_peered":"2023-01-25T04:47:49.231045+0000","last_unstale":"2023-01-25T04:47:49.234940+0000","last_undegraded":"2023-01-25T04:47:49.234940+0000","last_fullsized":"2023-01-25T04:47:49.234940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:13.319483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.235009+0000","last_change":"2023-01-25T04:47:49.231282+0000","last_active":"2023-01-25T04:47:49.235009+0000","last_peered":"2023-01-25T04:47:49.235009+0000","last_clean":"2023-01-25T04:47:49.235009+0000","last_became_active":"2023-01-25T04:47:49.230987+0000","last_became_peered":"2023-01-25T04:47:49.230987+0000","last_unstale":"2023-01-25T04:47:49.235009+0000","last_undegraded":"2023-01-25T04:47:49.235009+0000","last_fullsized":"2023-01-25T04:47:49.235009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:07.604186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'85","reported_seq":124,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.496492+0000","last_change":"2023-01-25T04:47:47.424067+0000","last_active":"2023-01-25T04:47:50.496492+0000","last_peered":"2023-01-25T04:47:50.496492+0000","last_clean":"2023-01-25T04:47:50.496492+0000","last_became_active":"2023-01-25T04:47:47.423064+0000","last_became_peered":"2023-01-25T04:47:47.423064+0000","last_unstale":"2023-01-25T04:47:50.496492+0000","last_undegraded":"2023-01-25T04:47:50.496492+0000","last_fullsized":"2023-01-25T04:47:50.496492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:46.178558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:46.178558+0000","last_clean_scrub_stamp":"2023-01-25T04:47:46.178558+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:02.591057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.573340+0000","last_change":"2023-01-25T04:47:49.227891+0000","last_active":"2023-01-25T04:47:50.573340+0000","last_peered":"2023-01-25T04:47:50.573340+0000","last_clean":"2023-01-25T04:47:50.573340+0000","last_became_active":"2023-01-25T04:47:49.227491+0000","last_became_peered":"2023-01-25T04:47:49.227491+0000","last_unstale":"2023-01-25T04:47:50.573340+0000","last_undegraded":"2023-01-25T04:47:50.573340+0000","last_fullsized":"2023-01-25T04:47:50.573340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:07.911228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.218106+0000","last_change":"2023-01-25T04:47:49.231454+0000","last_active":"2023-01-25T04:47:50.218106+0000","last_peered":"2023-01-25T04:47:50.218106+0000","last_clean":"2023-01-25T04:47:50.218106+0000","last_became_active":"2023-01-25T04:47:49.231165+0000","last_became_peered":"2023-01-25T04:47:49.231165+0000","last_unstale":"2023-01-25T04:47:50.218106+0000","last_undegraded":"2023-01-25T04:47:50.218106+0000","last_fullsized":"2023-01-25T04:47:50.218106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:53.582147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.573317+0000","last_change":"2023-01-25T04:47:49.227874+0000","last_active":"2023-01-25T04:47:50.573317+0000","last_peered":"2023-01-25T04:47:50.573317+0000","last_clean":"2023-01-25T04:47:50.573317+0000","last_became_active":"2023-01-25T04:47:49.227588+0000","last_became_peered":"2023-01-25T04:47:49.227588+0000","last_unstale":"2023-01-25T04:47:50.573317+0000","last_undegraded":"2023-01-25T04:47:50.573317+0000","last_fullsized":"2023-01-25T04:47:50.573317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:57.751315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.195267+0000","last_change":"2023-01-25T04:47:49.231435+0000","last_active":"2023-01-25T04:47:50.195267+0000","last_peered":"2023-01-25T04:47:50.195267+0000","last_clean":"2023-01-25T04:47:50.195267+0000","last_became_active":"2023-01-25T04:47:49.231094+0000","last_became_peered":"2023-01-25T04:47:49.231094+0000","last_unstale":"2023-01-25T04:47:50.195267+0000","last_undegraded":"2023-01-25T04:47:50.195267+0000","last_fullsized":"2023-01-25T04:47:50.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:58.455560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1216548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6056,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94365784,"statfs":{"total":96636764160,"available":96630562816,"internally_reserved":0,"allocated":557056,"data_stored":451019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5988,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94365852,"statfs":{"total":96636764160,"available":96630632448,"internally_reserved":0,"allocated":552960,"data_stored":450000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":50131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6116,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94365724,"statfs":{"total":96636764160,"available":96630501376,"internally_reserved":0,"allocated":557056,"data_stored":451019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":50131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":973.05399999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5016,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366824,"statfs":{"total":96636764160,"available":96631627776,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8620000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3279999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T04:47:53.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T04:47:53.711 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:53.714 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-01-25T04:47:53.725 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2023-01-25T04:47:53.170562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":43512,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":40256,"kb_avail":754931208,"statfs":{"total":773094113280,"available":773049556992,"internally_reserved":0,"allocated":2420736,"data_stored":1588809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41222144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.954494"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.234962+0000","last_change":"2023-01-25T04:47:49.227848+0000","last_active":"2023-01-25T04:47:49.234962+0000","last_peered":"2023-01-25T04:47:49.234962+0000","last_clean":"2023-01-25T04:47:49.234962+0000","last_became_active":"2023-01-25T04:47:49.227478+0000","last_became_peered":"2023-01-25T04:47:49.227478+0000","last_unstale":"2023-01-25T04:47:49.234962+0000","last_undegraded":"2023-01-25T04:47:49.234962+0000","last_fullsized":"2023-01-25T04:47:49.234962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:04.022357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.195287+0000","last_change":"2023-01-25T04:47:49.228105+0000","last_active":"2023-01-25T04:47:50.195287+0000","last_peered":"2023-01-25T04:47:50.195287+0000","last_clean":"2023-01-25T04:47:50.195287+0000","last_became_active":"2023-01-25T04:47:49.227485+0000","last_became_peered":"2023-01-25T04:47:49.227485+0000","last_unstale":"2023-01-25T04:47:50.195287+0000","last_undegraded":"2023-01-25T04:47:50.195287+0000","last_fullsized":"2023-01-25T04:47:50.195287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:05.231608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.234940+0000","last_change":"2023-01-25T04:47:49.231399+0000","last_active":"2023-01-25T04:47:49.234940+0000","last_peered":"2023-01-25T04:47:49.234940+0000","last_clean":"2023-01-25T04:47:49.234940+0000","last_became_active":"2023-01-25T04:47:49.231045+0000","last_became_peered":"2023-01-25T04:47:49.231045+0000","last_unstale":"2023-01-25T04:47:49.234940+0000","last_undegraded":"2023-01-25T04:47:49.234940+0000","last_fullsized":"2023-01-25T04:47:49.234940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:13.319483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.235009+0000","last_change":"2023-01-25T04:47:49.231282+0000","last_active":"2023-01-25T04:47:49.235009+0000","last_peered":"2023-01-25T04:47:49.235009+0000","last_clean":"2023-01-25T04:47:49.235009+0000","last_became_active":"2023-01-25T04:47:49.230987+0000","last_became_peered":"2023-01-25T04:47:49.230987+0000","last_unstale":"2023-01-25T04:47:49.235009+0000","last_undegraded":"2023-01-25T04:47:49.235009+0000","last_fullsized":"2023-01-25T04:47:49.235009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:07.604186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'85","reported_seq":124,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.496492+0000","last_change":"2023-01-25T04:47:47.424067+0000","last_active":"2023-01-25T04:47:50.496492+0000","last_peered":"2023-01-25T04:47:50.496492+0000","last_clean":"2023-01-25T04:47:50.496492+0000","last_became_active":"2023-01-25T04:47:47.423064+0000","last_became_peered":"2023-01-25T04:47:47.423064+0000","last_unstale":"2023-01-25T04:47:50.496492+0000","last_undegraded":"2023-01-25T04:47:50.496492+0000","last_fullsized":"2023-01-25T04:47:50.496492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:46.178558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:46.178558+0000","last_clean_scrub_stamp":"2023-01-25T04:47:46.178558+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:02.591057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.573340+0000","last_change":"2023-01-25T04:47:49.227891+0000","last_active":"2023-01-25T04:47:50.573340+0000","last_peered":"2023-01-25T04:47:50.573340+0000","last_clean":"2023-01-25T04:47:50.573340+0000","last_became_active":"2023-01-25T04:47:49.227491+0000","last_became_peered":"2023-01-25T04:47:49.227491+0000","last_unstale":"2023-01-25T04:47:50.573340+0000","last_undegraded":"2023-01-25T04:47:50.573340+0000","last_fullsized":"2023-01-25T04:47:50.573340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:07.911228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.218106+0000","last_change":"2023-01-25T04:47:49.231454+0000","last_active":"2023-01-25T04:47:50.218106+0000","last_peered":"2023-01-25T04:47:50.218106+0000","last_clean":"2023-01-25T04:47:50.218106+0000","last_became_active":"2023-01-25T04:47:49.231165+0000","last_became_peered":"2023-01-25T04:47:49.231165+0000","last_unstale":"2023-01-25T04:47:50.218106+0000","last_undegraded":"2023-01-25T04:47:50.218106+0000","last_fullsized":"2023-01-25T04:47:50.218106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:53.582147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.573317+0000","last_change":"2023-01-25T04:47:49.227874+0000","last_active":"2023-01-25T04:47:50.573317+0000","last_peered":"2023-01-25T04:47:50.573317+0000","last_clean":"2023-01-25T04:47:50.573317+0000","last_became_active":"2023-01-25T04:47:49.227588+0000","last_became_peered":"2023-01-25T04:47:49.227588+0000","last_unstale":"2023-01-25T04:47:50.573317+0000","last_undegraded":"2023-01-25T04:47:50.573317+0000","last_fullsized":"2023-01-25T04:47:50.573317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:57.751315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.195267+0000","last_change":"2023-01-25T04:47:49.231435+0000","last_active":"2023-01-25T04:47:50.195267+0000","last_peered":"2023-01-25T04:47:50.195267+0000","last_clean":"2023-01-25T04:47:50.195267+0000","last_became_active":"2023-01-25T04:47:49.231094+0000","last_became_peered":"2023-01-25T04:47:49.231094+0000","last_unstale":"2023-01-25T04:47:50.195267+0000","last_undegraded":"2023-01-25T04:47:50.195267+0000","last_fullsized":"2023-01-25T04:47:50.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:58.455560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1216548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6056,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94365784,"statfs":{"total":96636764160,"available":96630562816,"internally_reserved":0,"allocated":557056,"data_stored":451019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5988,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94365852,"statfs":{"total":96636764160,"available":96630632448,"internally_reserved":0,"allocated":552960,"data_stored":450000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":50131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6116,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94365724,"statfs":{"total":96636764160,"available":96630501376,"internally_reserved":0,"allocated":557056,"data_stored":451019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":50131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":973.05399999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5016,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366824,"statfs":{"total":96636764160,"available":96631627776,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8620000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3279999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T04:47:53.727 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T04:47:53.727 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-25T04:47:53.727 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-25T04:47:53.727 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-25T04:47:54.083 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:54.083 INFO:teuthology.orchestra.run.smithi149.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-25T04:47:54.097 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-25T04:47:54.098 INFO:teuthology.run_tasks:Running task thrashosds... 2023-01-25T04:47:54.107 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-25T04:47:54.108 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri-testing-2023-01-23-0926'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-yuri-testing-2023-01-23-0926', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}} 2023-01-25T04:47:54.108 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4} 2023-01-25T04:47:54.108 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-01-25T04:47:54.455 INFO:tasks.thrashosds:Beginning thrashosds... 2023-01-25T04:47:54.455 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T04:47:54.455 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T04:47:54.771 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:54.773 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-01-25T04:47:54.784 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2023-01-25T04:47:53.170562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":43512,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":40256,"kb_avail":754931208,"statfs":{"total":773094113280,"available":773049556992,"internally_reserved":0,"allocated":2420736,"data_stored":1588809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41222144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.954494"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.234962+0000","last_change":"2023-01-25T04:47:49.227848+0000","last_active":"2023-01-25T04:47:49.234962+0000","last_peered":"2023-01-25T04:47:49.234962+0000","last_clean":"2023-01-25T04:47:49.234962+0000","last_became_active":"2023-01-25T04:47:49.227478+0000","last_became_peered":"2023-01-25T04:47:49.227478+0000","last_unstale":"2023-01-25T04:47:49.234962+0000","last_undegraded":"2023-01-25T04:47:49.234962+0000","last_fullsized":"2023-01-25T04:47:49.234962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:04.022357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.195287+0000","last_change":"2023-01-25T04:47:49.228105+0000","last_active":"2023-01-25T04:47:50.195287+0000","last_peered":"2023-01-25T04:47:50.195287+0000","last_clean":"2023-01-25T04:47:50.195287+0000","last_became_active":"2023-01-25T04:47:49.227485+0000","last_became_peered":"2023-01-25T04:47:49.227485+0000","last_unstale":"2023-01-25T04:47:50.195287+0000","last_undegraded":"2023-01-25T04:47:50.195287+0000","last_fullsized":"2023-01-25T04:47:50.195287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:05.231608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.234940+0000","last_change":"2023-01-25T04:47:49.231399+0000","last_active":"2023-01-25T04:47:49.234940+0000","last_peered":"2023-01-25T04:47:49.234940+0000","last_clean":"2023-01-25T04:47:49.234940+0000","last_became_active":"2023-01-25T04:47:49.231045+0000","last_became_peered":"2023-01-25T04:47:49.231045+0000","last_unstale":"2023-01-25T04:47:49.234940+0000","last_undegraded":"2023-01-25T04:47:49.234940+0000","last_fullsized":"2023-01-25T04:47:49.234940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:13.319483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.235009+0000","last_change":"2023-01-25T04:47:49.231282+0000","last_active":"2023-01-25T04:47:49.235009+0000","last_peered":"2023-01-25T04:47:49.235009+0000","last_clean":"2023-01-25T04:47:49.235009+0000","last_became_active":"2023-01-25T04:47:49.230987+0000","last_became_peered":"2023-01-25T04:47:49.230987+0000","last_unstale":"2023-01-25T04:47:49.235009+0000","last_undegraded":"2023-01-25T04:47:49.235009+0000","last_fullsized":"2023-01-25T04:47:49.235009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:07.604186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'85","reported_seq":124,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.496492+0000","last_change":"2023-01-25T04:47:47.424067+0000","last_active":"2023-01-25T04:47:50.496492+0000","last_peered":"2023-01-25T04:47:50.496492+0000","last_clean":"2023-01-25T04:47:50.496492+0000","last_became_active":"2023-01-25T04:47:47.423064+0000","last_became_peered":"2023-01-25T04:47:47.423064+0000","last_unstale":"2023-01-25T04:47:50.496492+0000","last_undegraded":"2023-01-25T04:47:50.496492+0000","last_fullsized":"2023-01-25T04:47:50.496492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:46.178558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:46.178558+0000","last_clean_scrub_stamp":"2023-01-25T04:47:46.178558+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:02.591057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.573340+0000","last_change":"2023-01-25T04:47:49.227891+0000","last_active":"2023-01-25T04:47:50.573340+0000","last_peered":"2023-01-25T04:47:50.573340+0000","last_clean":"2023-01-25T04:47:50.573340+0000","last_became_active":"2023-01-25T04:47:49.227491+0000","last_became_peered":"2023-01-25T04:47:49.227491+0000","last_unstale":"2023-01-25T04:47:50.573340+0000","last_undegraded":"2023-01-25T04:47:50.573340+0000","last_fullsized":"2023-01-25T04:47:50.573340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:07.911228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.218106+0000","last_change":"2023-01-25T04:47:49.231454+0000","last_active":"2023-01-25T04:47:50.218106+0000","last_peered":"2023-01-25T04:47:50.218106+0000","last_clean":"2023-01-25T04:47:50.218106+0000","last_became_active":"2023-01-25T04:47:49.231165+0000","last_became_peered":"2023-01-25T04:47:49.231165+0000","last_unstale":"2023-01-25T04:47:50.218106+0000","last_undegraded":"2023-01-25T04:47:50.218106+0000","last_fullsized":"2023-01-25T04:47:50.218106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:53.582147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.573317+0000","last_change":"2023-01-25T04:47:49.227874+0000","last_active":"2023-01-25T04:47:50.573317+0000","last_peered":"2023-01-25T04:47:50.573317+0000","last_clean":"2023-01-25T04:47:50.573317+0000","last_became_active":"2023-01-25T04:47:49.227588+0000","last_became_peered":"2023-01-25T04:47:49.227588+0000","last_unstale":"2023-01-25T04:47:50.573317+0000","last_undegraded":"2023-01-25T04:47:50.573317+0000","last_fullsized":"2023-01-25T04:47:50.573317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:57.751315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.195267+0000","last_change":"2023-01-25T04:47:49.231435+0000","last_active":"2023-01-25T04:47:50.195267+0000","last_peered":"2023-01-25T04:47:50.195267+0000","last_clean":"2023-01-25T04:47:50.195267+0000","last_became_active":"2023-01-25T04:47:49.231094+0000","last_became_peered":"2023-01-25T04:47:49.231094+0000","last_unstale":"2023-01-25T04:47:50.195267+0000","last_undegraded":"2023-01-25T04:47:50.195267+0000","last_fullsized":"2023-01-25T04:47:50.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:58.455560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1216548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6056,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94365784,"statfs":{"total":96636764160,"available":96630562816,"internally_reserved":0,"allocated":557056,"data_stored":451019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5988,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94365852,"statfs":{"total":96636764160,"available":96630632448,"internally_reserved":0,"allocated":552960,"data_stored":450000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":50131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6116,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94365724,"statfs":{"total":96636764160,"available":96630501376,"internally_reserved":0,"allocated":557056,"data_stored":451019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":50131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":973.05399999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5016,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366824,"statfs":{"total":96636764160,"available":96631627776,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8620000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3279999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T04:47:54.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T04:47:55.100 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-25T04:47:55.102 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-01-25T04:47:55.113 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2023-01-25T04:47:53.170562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":43512,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":40256,"kb_avail":754931208,"statfs":{"total":773094113280,"available":773049556992,"internally_reserved":0,"allocated":2420736,"data_stored":1588809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41222144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.954494"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.234962+0000","last_change":"2023-01-25T04:47:49.227848+0000","last_active":"2023-01-25T04:47:49.234962+0000","last_peered":"2023-01-25T04:47:49.234962+0000","last_clean":"2023-01-25T04:47:49.234962+0000","last_became_active":"2023-01-25T04:47:49.227478+0000","last_became_peered":"2023-01-25T04:47:49.227478+0000","last_unstale":"2023-01-25T04:47:49.234962+0000","last_undegraded":"2023-01-25T04:47:49.234962+0000","last_fullsized":"2023-01-25T04:47:49.234962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:04.022357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.195287+0000","last_change":"2023-01-25T04:47:49.228105+0000","last_active":"2023-01-25T04:47:50.195287+0000","last_peered":"2023-01-25T04:47:50.195287+0000","last_clean":"2023-01-25T04:47:50.195287+0000","last_became_active":"2023-01-25T04:47:49.227485+0000","last_became_peered":"2023-01-25T04:47:49.227485+0000","last_unstale":"2023-01-25T04:47:50.195287+0000","last_undegraded":"2023-01-25T04:47:50.195287+0000","last_fullsized":"2023-01-25T04:47:50.195287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:05.231608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.234940+0000","last_change":"2023-01-25T04:47:49.231399+0000","last_active":"2023-01-25T04:47:49.234940+0000","last_peered":"2023-01-25T04:47:49.234940+0000","last_clean":"2023-01-25T04:47:49.234940+0000","last_became_active":"2023-01-25T04:47:49.231045+0000","last_became_peered":"2023-01-25T04:47:49.231045+0000","last_unstale":"2023-01-25T04:47:49.234940+0000","last_undegraded":"2023-01-25T04:47:49.234940+0000","last_fullsized":"2023-01-25T04:47:49.234940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:13.319483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:49.235009+0000","last_change":"2023-01-25T04:47:49.231282+0000","last_active":"2023-01-25T04:47:49.235009+0000","last_peered":"2023-01-25T04:47:49.235009+0000","last_clean":"2023-01-25T04:47:49.235009+0000","last_became_active":"2023-01-25T04:47:49.230987+0000","last_became_peered":"2023-01-25T04:47:49.230987+0000","last_unstale":"2023-01-25T04:47:49.235009+0000","last_undegraded":"2023-01-25T04:47:49.235009+0000","last_fullsized":"2023-01-25T04:47:49.235009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:07.604186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'85","reported_seq":124,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.496492+0000","last_change":"2023-01-25T04:47:47.424067+0000","last_active":"2023-01-25T04:47:50.496492+0000","last_peered":"2023-01-25T04:47:50.496492+0000","last_clean":"2023-01-25T04:47:50.496492+0000","last_became_active":"2023-01-25T04:47:47.423064+0000","last_became_peered":"2023-01-25T04:47:47.423064+0000","last_unstale":"2023-01-25T04:47:50.496492+0000","last_undegraded":"2023-01-25T04:47:50.496492+0000","last_fullsized":"2023-01-25T04:47:50.496492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:46.178558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:46.178558+0000","last_clean_scrub_stamp":"2023-01-25T04:47:46.178558+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:02.591057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.573340+0000","last_change":"2023-01-25T04:47:49.227891+0000","last_active":"2023-01-25T04:47:50.573340+0000","last_peered":"2023-01-25T04:47:50.573340+0000","last_clean":"2023-01-25T04:47:50.573340+0000","last_became_active":"2023-01-25T04:47:49.227491+0000","last_became_peered":"2023-01-25T04:47:49.227491+0000","last_unstale":"2023-01-25T04:47:50.573340+0000","last_undegraded":"2023-01-25T04:47:50.573340+0000","last_fullsized":"2023-01-25T04:47:50.573340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:49:07.911228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.218106+0000","last_change":"2023-01-25T04:47:49.231454+0000","last_active":"2023-01-25T04:47:50.218106+0000","last_peered":"2023-01-25T04:47:50.218106+0000","last_clean":"2023-01-25T04:47:50.218106+0000","last_became_active":"2023-01-25T04:47:49.231165+0000","last_became_peered":"2023-01-25T04:47:49.231165+0000","last_unstale":"2023-01-25T04:47:50.218106+0000","last_undegraded":"2023-01-25T04:47:50.218106+0000","last_fullsized":"2023-01-25T04:47:50.218106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:53.582147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.573317+0000","last_change":"2023-01-25T04:47:49.227874+0000","last_active":"2023-01-25T04:47:50.573317+0000","last_peered":"2023-01-25T04:47:50.573317+0000","last_clean":"2023-01-25T04:47:50.573317+0000","last_became_active":"2023-01-25T04:47:49.227588+0000","last_became_peered":"2023-01-25T04:47:49.227588+0000","last_unstale":"2023-01-25T04:47:50.573317+0000","last_undegraded":"2023-01-25T04:47:50.573317+0000","last_fullsized":"2023-01-25T04:47:50.573317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:57.751315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T04:47:50.195267+0000","last_change":"2023-01-25T04:47:49.231435+0000","last_active":"2023-01-25T04:47:50.195267+0000","last_peered":"2023-01-25T04:47:50.195267+0000","last_clean":"2023-01-25T04:47:50.195267+0000","last_became_active":"2023-01-25T04:47:49.231094+0000","last_became_peered":"2023-01-25T04:47:49.231094+0000","last_unstale":"2023-01-25T04:47:50.195267+0000","last_undegraded":"2023-01-25T04:47:50.195267+0000","last_fullsized":"2023-01-25T04:47:50.195267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:47:48.199181+0000","last_clean_scrub_stamp":"2023-01-25T04:47:48.199181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T04:48:58.455560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":123,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":1216548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6056,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94365784,"statfs":{"total":96636764160,"available":96630562816,"internally_reserved":0,"allocated":557056,"data_stored":451019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5988,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94365852,"statfs":{"total":96636764160,"available":96630632448,"internally_reserved":0,"allocated":552960,"data_stored":450000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":50131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6116,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":94365724,"statfs":{"total":96636764160,"available":96630501376,"internally_reserved":0,"allocated":557056,"data_stored":451019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":50131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":973.05399999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5016,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366824,"statfs":{"total":96636764160,"available":96631627776,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8620000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3279999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":405516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T04:47:55.115 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T04:47:55.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-01-25T04:47:55.434 INFO:teuthology.orchestra.run.smithi149.stdout:epoch 18 2023-01-25T04:47:55.434 INFO:teuthology.orchestra.run.smithi149.stdout:fsid 629f2296-7568-47e9-b1d7-daec4aeb5f55 2023-01-25T04:47:55.434 INFO:teuthology.orchestra.run.smithi149.stdout:created 2023-01-25T04:47:35.793813+0000 2023-01-25T04:47:55.434 INFO:teuthology.orchestra.run.smithi149.stdout:modified 2023-01-25T04:47:50.209414+0000 2023-01-25T04:47:55.435 INFO:teuthology.orchestra.run.smithi149.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-25T04:47:55.435 INFO:teuthology.orchestra.run.smithi149.stdout:crush_version 4 2023-01-25T04:47:55.435 INFO:teuthology.orchestra.run.smithi149.stdout:full_ratio 0.95 2023-01-25T04:47:55.435 INFO:teuthology.orchestra.run.smithi149.stdout:backfillfull_ratio 0.9 2023-01-25T04:47:55.436 INFO:teuthology.orchestra.run.smithi149.stdout:nearfull_ratio 0.85 2023-01-25T04:47:55.436 INFO:teuthology.orchestra.run.smithi149.stdout:require_min_compat_client luminous 2023-01-25T04:47:55.437 INFO:teuthology.orchestra.run.smithi149.stdout:min_compat_client jewel 2023-01-25T04:47:55.437 INFO:teuthology.orchestra.run.smithi149.stdout:require_osd_release reef 2023-01-25T04:47:55.437 INFO:teuthology.orchestra.run.smithi149.stdout:stretch_mode_enabled false 2023-01-25T04:47:55.437 INFO:teuthology.orchestra.run.smithi149.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-01-25T04:47:55.437 INFO:teuthology.orchestra.run.smithi149.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 application rbd 2023-01-25T04:47:55.438 INFO:teuthology.orchestra.run.smithi149.stdout:max_osd 8 2023-01-25T04:47:55.438 INFO:teuthology.orchestra.run.smithi149.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.149:6800/93008 v2:172.21.15.149:6801/93008 exists,up 50ebe746-cf24-467b-8507-327fde9bf001 2023-01-25T04:47:55.438 INFO:teuthology.orchestra.run.smithi149.stdout:osd.1 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.149:6804/93009 v2:172.21.15.149:6805/93009 exists,up 65a94fff-022e-4590-88c7-29a290231bcb 2023-01-25T04:47:55.438 INFO:teuthology.orchestra.run.smithi149.stdout:osd.2 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.149:6808/93018 v2:172.21.15.149:6809/93018 exists,up 599c8478-1fcc-4770-9383-2c442608a44b 2023-01-25T04:47:55.438 INFO:teuthology.orchestra.run.smithi149.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.149:6812/93019 v2:172.21.15.149:6813/93019 exists,up b5a89885-d861-4689-a1ea-bc4095a71cba 2023-01-25T04:47:55.439 INFO:teuthology.orchestra.run.smithi149.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.154:6804/92973 v2:172.21.15.154:6805/92973 exists,up 4eed053d-6485-4517-8623-6338721d0f2c 2023-01-25T04:47:55.439 INFO:teuthology.orchestra.run.smithi149.stdout:osd.5 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.154:6800/92974 v2:172.21.15.154:6801/92974 exists,up 227f35a6-fcaa-4265-a9ee-01ec1b98bb6f 2023-01-25T04:47:55.439 INFO:teuthology.orchestra.run.smithi149.stdout:osd.6 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.154:6812/92998 v2:172.21.15.154:6813/92998 exists,up 52339049-79dd-49c4-acd0-ca38ed7ccf99 2023-01-25T04:47:55.439 INFO:teuthology.orchestra.run.smithi149.stdout:osd.7 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.154:6808/92984 v2:172.21.15.154:6809/92984 exists,up 4c7d0cef-7d24-4cb3-b21d-5e246dbd7a8c 2023-01-25T04:47:55.450 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.149:6800/93008 v2:172.21.15.149:6801/93008 exists,up 50ebe746-cf24-467b-8507-327fde9bf001', 'osd.1 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.149:6804/93009 v2:172.21.15.149:6805/93009 exists,up 65a94fff-022e-4590-88c7-29a290231bcb', 'osd.2 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.149:6808/93018 v2:172.21.15.149:6809/93018 exists,up 599c8478-1fcc-4770-9383-2c442608a44b', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.149:6812/93019 v2:172.21.15.149:6813/93019 exists,up b5a89885-d861-4689-a1ea-bc4095a71cba', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.154:6804/92973 v2:172.21.15.154:6805/92973 exists,up 4eed053d-6485-4517-8623-6338721d0f2c', 'osd.5 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.154:6800/92974 v2:172.21.15.154:6801/92974 exists,up 227f35a6-fcaa-4265-a9ee-01ec1b98bb6f', 'osd.6 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.154:6812/92998 v2:172.21.15.154:6813/92998 exists,up 52339049-79dd-49c4-acd0-ca38ed7ccf99', 'osd.7 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.154:6808/92984 v2:172.21.15.154:6809/92984 exists,up 4c7d0cef-7d24-4cb3-b21d-5e246dbd7a8c'] 2023-01-25T04:47:55.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-01-25T04:47:55.572 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-01-25T04:47:55.572 INFO:teuthology.orchestra.run.smithi149.stdout: "name": "mon.a", 2023-01-25T04:47:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster": "ceph", 2023-01-25T04:47:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-01-25T04:47:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "admin_socket_mode": "", 2023-01-25T04:47:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-01-25T04:47:55.573 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_client_required": "cephx, none", 2023-01-25T04:47:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_cluster_required": "cephx", 2023-01-25T04:47:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_debug": "true", 2023-01-25T04:47:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-01-25T04:47:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-01-25T04:47:55.574 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_service_required": "cephx", 2023-01-25T04:47:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_service_ticket_ttl": "240.000000", 2023-01-25T04:47:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_supported": "cephx", 2023-01-25T04:47:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_aio": "true", 2023-01-25T04:47:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_aio_max_queue_depth": "1024", 2023-01-25T04:47:55.575 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_aio_poll_ms": "250", 2023-01-25T04:47:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_aio_reap_max": "16", 2023-01-25T04:47:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_async_discard": "false", 2023-01-25T04:47:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_block_size": "4096", 2023-01-25T04:47:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_debug_aio": "false", 2023-01-25T04:47:55.576 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-01-25T04:47:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-01-25T04:47:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_debug_inflight_ios": "false", 2023-01-25T04:47:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_enable_discard": "false", 2023-01-25T04:47:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_flock_retry": "3", 2023-01-25T04:47:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_flock_retry_interval": "0.100000", 2023-01-25T04:47:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_inject_crash": "0", 2023-01-25T04:47:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_inject_crash_flush_delay": "2", 2023-01-25T04:47:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_ioring": "false", 2023-01-25T04:47:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_ioring_hipri": "false", 2023-01-25T04:47:55.578 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_ioring_sqthread_poll": "false", 2023-01-25T04:47:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-01-25T04:47:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_read_buffer_alignment": "4096", 2023-01-25T04:47:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-01-25T04:47:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "bdev_type": "", 2023-01-25T04:47:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_alloc_size": "1048576", 2023-01-25T04:47:55.579 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_allocator": "hybrid", 2023-01-25T04:47:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_buffered_io": "true", 2023-01-25T04:47:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_check_for_zeros": "false", 2023-01-25T04:47:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_check_volume_selector_often": "false", 2023-01-25T04:47:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-01-25T04:47:55.580 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_compact_log_sync": "false", 2023-01-25T04:47:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-01-25T04:47:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_log_compact_min_size": "16777216", 2023-01-25T04:47:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_log_replay_check_allocations": "true", 2023-01-25T04:47:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_max_log_runway": "4194304", 2023-01-25T04:47:55.581 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_max_prefetch": "1048576", 2023-01-25T04:47:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_min_flush_size": "524288", 2023-01-25T04:47:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_min_log_runway": "1048576", 2023-01-25T04:47:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_replay_recovery": "false", 2023-01-25T04:47:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-01-25T04:47:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_shared_alloc_size": "65536", 2023-01-25T04:47:55.582 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_sync_write": "false", 2023-01-25T04:47:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-01-25T04:47:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-01-25T04:47:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-01-25T04:47:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_allocation_from_file": "true", 2023-01-25T04:47:55.583 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_allocator": "hybrid", 2023-01-25T04:47:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-01-25T04:47:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-01-25T04:47:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-01-25T04:47:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-01-25T04:47:55.584 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-01-25T04:47:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-01-25T04:47:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blobid_prealloc": "10240", 2023-01-25T04:47:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_create": "true", 2023-01-25T04:47:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_db_create": "false", 2023-01-25T04:47:55.585 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_db_path": "", 2023-01-25T04:47:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_db_size": "0", 2023-01-25T04:47:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_path": "", 2023-01-25T04:47:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_preallocate_file": "false", 2023-01-25T04:47:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_size": "107374182400", 2023-01-25T04:47:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_wal_create": "false", 2023-01-25T04:47:55.586 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_wal_path": "", 2023-01-25T04:47:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_block_wal_size": "100663296", 2023-01-25T04:47:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_bluefs": "true", 2023-01-25T04:47:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-01-25T04:47:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_bluefs_env_mirror": "false", 2023-01-25T04:47:55.587 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-01-25T04:47:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-01-25T04:47:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T04:47:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T04:47:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-01-25T04:47:55.588 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T04:47:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_autotune": "true", 2023-01-25T04:47:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-01-25T04:47:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-01-25T04:47:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-01-25T04:47:55.589 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-01-25T04:47:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_size": "0", 2023-01-25T04:47:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-01-25T04:47:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-01-25T04:47:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-01-25T04:47:55.590 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-01-25T04:47:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_type": "2q", 2023-01-25T04:47:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-01-25T04:47:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_clone_cow": "true", 2023-01-25T04:47:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_algorithm": "snappy", 2023-01-25T04:47:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_max_blob_size": "0", 2023-01-25T04:47:55.591 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-01-25T04:47:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-01-25T04:47:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_min_blob_size": "0", 2023-01-25T04:47:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-01-25T04:47:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-01-25T04:47:55.592 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_mode": "none", 2023-01-25T04:47:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-01-25T04:47:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_csum_type": "crc32c", 2023-01-25T04:47:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_enforce_settings": "default", 2023-01-25T04:47:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_freelist": "false", 2023-01-25T04:47:55.593 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_fsck_abort": "false", 2023-01-25T04:47:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-01-25T04:47:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_inject_bug21040": "false", 2023-01-25T04:47:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-01-25T04:47:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_inject_read_err": "false", 2023-01-25T04:47:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_legacy_omap": "false", 2023-01-25T04:47:55.594 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-01-25T04:47:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-01-25T04:47:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-01-25T04:47:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-01-25T04:47:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_prefill": "0.000000", 2023-01-25T04:47:55.595 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-01-25T04:47:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-01-25T04:47:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-01-25T04:47:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_small_allocations": "0", 2023-01-25T04:47:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-01-25T04:47:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_default_buffered_read": "true", 2023-01-25T04:47:55.596 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_default_buffered_write": "false", 2023-01-25T04:47:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_deferred_batch_ops": "0", 2023-01-25T04:47:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-01-25T04:47:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-01-25T04:47:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-01-25T04:47:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-01-25T04:47:55.597 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-01-25T04:47:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-01-25T04:47:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-01-25T04:47:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fail_eio": "false", 2023-01-25T04:47:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-01-25T04:47:55.598 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-01-25T04:47:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-01-25T04:47:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-01-25T04:47:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_on_mkfs": "true", 2023-01-25T04:47:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-01-25T04:47:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_on_mount": "false", 2023-01-25T04:47:55.599 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-01-25T04:47:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_on_umount": "false", 2023-01-25T04:47:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-01-25T04:47:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-01-25T04:47:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-01-25T04:47:55.600 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-01-25T04:47:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-01-25T04:47:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-01-25T04:47:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-01-25T04:47:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-01-25T04:47:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_ignore_data_csum": "false", 2023-01-25T04:47:55.601 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-01-25T04:47:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_kvbackend": "rocksdb", 2023-01-25T04:47:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-01-25T04:47:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-01-25T04:47:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_log_op_age": "5.000000", 2023-01-25T04:47:55.602 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_max_alloc_size": "0", 2023-01-25T04:47:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_max_blob_size": "0", 2023-01-25T04:47:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-01-25T04:47:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-01-25T04:47:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_max_defer_interval": "3.000000", 2023-01-25T04:47:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_max_deferred_txc": "32", 2023-01-25T04:47:55.603 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_min_alloc_size": "0", 2023-01-25T04:47:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-01-25T04:47:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-01-25T04:47:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_nid_prealloc": "1024", 2023-01-25T04:47:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_prefer_deferred_size": "0", 2023-01-25T04:47:55.604 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-01-25T04:47:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-01-25T04:47:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_qfsck_on_mount": "true", 2023-01-25T04:47:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_retry_disk_reads": "3", 2023-01-25T04:47:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_rocksdb_cf": "true", 2023-01-25T04:47:55.605 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2023-01-25T04:47:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=128,min_write_buffer_number_to_merge=16,compaction_style=kCompactionStyleLevel,write_buffer_size=8388608,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0,ttl=21600", 2023-01-25T04:47:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_rocksdb_options_annex": "", 2023-01-25T04:47:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_spdk_coremask": "0x1", 2023-01-25T04:47:55.606 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_spdk_io_sleep": "5", 2023-01-25T04:47:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_spdk_max_io_completion": "0", 2023-01-25T04:47:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_spdk_mem": "512", 2023-01-25T04:47:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_sync_submit_transaction": "false", 2023-01-25T04:47:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_throttle_bytes": "67108864", 2023-01-25T04:47:55.607 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_throttle_cost_per_io": "0", 2023-01-25T04:47:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-01-25T04:47:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-01-25T04:47:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-01-25T04:47:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-01-25T04:47:55.608 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_tracing": "false", 2023-01-25T04:47:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-01-25T04:47:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-01-25T04:47:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_volume_selection_reserved": "0", 2023-01-25T04:47:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-01-25T04:47:55.609 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-01-25T04:47:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-01-25T04:47:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-01-25T04:47:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-01-25T04:47:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-01-25T04:47:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_zero_block_detection": "false", 2023-01-25T04:47:55.610 INFO:teuthology.orchestra.run.smithi149.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-01-25T04:47:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_action_update_interval": "2", 2023-01-25T04:47:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-01-25T04:47:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-01-25T04:47:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-01-25T04:47:55.611 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-01-25T04:47:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_mount_timeout": "10", 2023-01-25T04:47:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-01-25T04:47:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-01-25T04:47:55.612 INFO:teuthology.orchestra.run.smithi149.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-01-25T04:47:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-01-25T04:47:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-01-25T04:47:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-01-25T04:47:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "cephx_cluster_require_signatures": "false", 2023-01-25T04:47:55.613 INFO:teuthology.orchestra.run.smithi149.stdout: "cephx_cluster_require_version": "2", 2023-01-25T04:47:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "cephx_require_signatures": "false", 2023-01-25T04:47:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "cephx_require_version": "2", 2023-01-25T04:47:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "cephx_service_require_signatures": "false", 2023-01-25T04:47:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "cephx_service_require_version": "2", 2023-01-25T04:47:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "cephx_sign_messages": "true", 2023-01-25T04:47:55.614 INFO:teuthology.orchestra.run.smithi149.stdout: "chdir": "", 2023-01-25T04:47:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client_acl_type": "", 2023-01-25T04:47:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client_asio_thread_count": "2", 2023-01-25T04:47:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client_cache_mid": "0.750000", 2023-01-25T04:47:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client_cache_size": "16384", 2023-01-25T04:47:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client_caps_release_delay": "5", 2023-01-25T04:47:55.615 INFO:teuthology.orchestra.run.smithi149.stdout: "client_check_pool_perm": "true", 2023-01-25T04:47:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_collect_and_send_global_metrics": "false", 2023-01-25T04:47:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_debug_force_sync_read": "false", 2023-01-25T04:47:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_debug_getattr_caps": "false", 2023-01-25T04:47:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_debug_inject_tick_delay": "0", 2023-01-25T04:47:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-01-25T04:47:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_die_on_failed_remount": "false", 2023-01-25T04:47:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_dirsize_rbytes": "true", 2023-01-25T04:47:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_force_lazyio": "false", 2023-01-25T04:47:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_fs": "", 2023-01-25T04:47:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_inject_fixed_oldest_tid": "false", 2023-01-25T04:47:55.617 INFO:teuthology.orchestra.run.smithi149.stdout: "client_inject_release_failure": "false", 2023-01-25T04:47:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_max_inline_size": "4096", 2023-01-25T04:47:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_mds_namespace": "", 2023-01-25T04:47:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_metadata": "", 2023-01-25T04:47:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_mount_gid": "-1", 2023-01-25T04:47:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_mount_timeout": "300", 2023-01-25T04:47:55.618 INFO:teuthology.orchestra.run.smithi149.stdout: "client_mount_uid": "-1", 2023-01-25T04:47:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "client_mountpoint": "/", 2023-01-25T04:47:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "client_notify_timeout": "10", 2023-01-25T04:47:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "client_oc": "true", 2023-01-25T04:47:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "client_oc_max_dirty": "104857600", 2023-01-25T04:47:55.619 INFO:teuthology.orchestra.run.smithi149.stdout: "client_oc_max_dirty_age": "5.000000", 2023-01-25T04:47:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_oc_max_objects": "1000", 2023-01-25T04:47:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_oc_size": "209715200", 2023-01-25T04:47:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_oc_target_dirty": "8388608", 2023-01-25T04:47:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_permissions": "true", 2023-01-25T04:47:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_quota": "true", 2023-01-25T04:47:55.620 INFO:teuthology.orchestra.run.smithi149.stdout: "client_quota_df": "true", 2023-01-25T04:47:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_readahead_max_bytes": "0", 2023-01-25T04:47:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_readahead_max_periods": "4", 2023-01-25T04:47:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_readahead_min": "131072", 2023-01-25T04:47:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_reconnect_stale": "false", 2023-01-25T04:47:55.621 INFO:teuthology.orchestra.run.smithi149.stdout: "client_shutdown_timeout": "30", 2023-01-25T04:47:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_snapdir": ".snap", 2023-01-25T04:47:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_tick_interval": "1", 2023-01-25T04:47:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_trace": "", 2023-01-25T04:47:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_try_dentry_invalidate": "false", 2023-01-25T04:47:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_use_faked_inos": "false", 2023-01-25T04:47:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "client_use_random_mds": "false", 2023-01-25T04:47:55.622 INFO:teuthology.orchestra.run.smithi149.stdout: "clog_to_graylog": "false", 2023-01-25T04:47:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-01-25T04:47:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "clog_to_graylog_port": "12201", 2023-01-25T04:47:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "clog_to_monitors": "default=true", 2023-01-25T04:47:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "clog_to_syslog": "false", 2023-01-25T04:47:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-01-25T04:47:55.623 INFO:teuthology.orchestra.run.smithi149.stdout: "clog_to_syslog_level": "info", 2023-01-25T04:47:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_addr": "-", 2023-01-25T04:47:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_network": "", 2023-01-25T04:47:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_network_interface": "", 2023-01-25T04:47:55.624 INFO:teuthology.orchestra.run.smithi149.stdout: "compressor_zlib_isal": "false", 2023-01-25T04:47:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "compressor_zlib_level": "5", 2023-01-25T04:47:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "compressor_zlib_winsize": "-15", 2023-01-25T04:47:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "compressor_zstd_level": "1", 2023-01-25T04:47:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-01-25T04:47:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-01-25T04:47:55.625 INFO:teuthology.orchestra.run.smithi149.stdout: "crimson_alien_op_num_threads": "6", 2023-01-25T04:47:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "crimson_alien_thread_cpu_cores": "", 2023-01-25T04:47:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "crimson_osd_obc_lru_size": "10", 2023-01-25T04:47:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-01-25T04:47:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "crimson_seastar_smp": "1", 2023-01-25T04:47:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "crush_location": "", 2023-01-25T04:47:55.626 INFO:teuthology.orchestra.run.smithi149.stdout: "crush_location_hook": "", 2023-01-25T04:47:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "crush_location_hook_timeout": "10", 2023-01-25T04:47:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "daemonize": "false", 2023-01-25T04:47:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "daos_pool": "tank", 2023-01-25T04:47:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-01-25T04:47:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-01-25T04:47:55.627 INFO:teuthology.orchestra.run.smithi149.stdout: "dbstore_db_name_prefix": "dbstore", 2023-01-25T04:47:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_alienstore": "0/5", 2023-01-25T04:47:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_allow_any_pool_priority": "false", 2023-01-25T04:47:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_asok": "1/5", 2023-01-25T04:47:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_asok_assert_abort": "false", 2023-01-25T04:47:55.628 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_asserts_on_shutdown": "true", 2023-01-25T04:47:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_auth": "20/20", 2023-01-25T04:47:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_bdev": "1/3", 2023-01-25T04:47:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_bluefs": "1/5", 2023-01-25T04:47:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_bluestore": "1/5", 2023-01-25T04:47:55.629 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_buffer": "0/1", 2023-01-25T04:47:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_ceph_exporter": "1/5", 2023-01-25T04:47:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_cephfs_mirror": "0/5", 2023-01-25T04:47:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_cephsqlite": "0/5", 2023-01-25T04:47:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_client": "0/5", 2023-01-25T04:47:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_compressor": "1/5", 2023-01-25T04:47:55.630 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_context": "0/1", 2023-01-25T04:47:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_crush": "1/1", 2023-01-25T04:47:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_crypto": "1/5", 2023-01-25T04:47:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_cyanstore": "0/5", 2023-01-25T04:47:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_deliberately_leak_memory": "false", 2023-01-25T04:47:55.631 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_disable_randomized_ping": "false", 2023-01-25T04:47:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_dpdk": "1/5", 2023-01-25T04:47:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_eventtrace": "1/5", 2023-01-25T04:47:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_filer": "0/1", 2023-01-25T04:47:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_filestore": "1/3", 2023-01-25T04:47:55.632 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_finisher": "1/1", 2023-01-25T04:47:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_fuse": "1/5", 2023-01-25T04:47:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_heartbeat_testing_span": "0", 2023-01-25T04:47:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_heartbeatmap": "1/5", 2023-01-25T04:47:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_immutable_obj_cache": "0/5", 2023-01-25T04:47:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_javaclient": "1/5", 2023-01-25T04:47:55.633 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_journal": "1/3", 2023-01-25T04:47:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_journaler": "0/5", 2023-01-25T04:47:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_kstore": "1/5", 2023-01-25T04:47:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_leveldb": "4/5", 2023-01-25T04:47:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_lockdep": "0/1", 2023-01-25T04:47:55.634 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mclock": "1/5", 2023-01-25T04:47:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mds": "1/5", 2023-01-25T04:47:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mds_balancer": "1/5", 2023-01-25T04:47:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mds_locker": "1/5", 2023-01-25T04:47:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mds_log": "1/5", 2023-01-25T04:47:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mds_log_expire": "1/5", 2023-01-25T04:47:55.635 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mds_migrator": "1/5", 2023-01-25T04:47:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_memstore": "1/5", 2023-01-25T04:47:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mgr": "2/5", 2023-01-25T04:47:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mgrc": "1/5", 2023-01-25T04:47:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_mon": "20/20", 2023-01-25T04:47:55.636 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_monc": "0/10", 2023-01-25T04:47:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_ms": "1/1", 2023-01-25T04:47:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_none": "0/5", 2023-01-25T04:47:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_objclass": "0/5", 2023-01-25T04:47:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_objectcacher": "0/5", 2023-01-25T04:47:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_objecter": "0/1", 2023-01-25T04:47:55.637 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_optracker": "0/5", 2023-01-25T04:47:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_osd": "1/5", 2023-01-25T04:47:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_paxos": "20/20", 2023-01-25T04:47:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_perfcounter": "1/5", 2023-01-25T04:47:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_prioritycache": "1/5", 2023-01-25T04:47:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rados": "0/5", 2023-01-25T04:47:55.638 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rbd": "0/5", 2023-01-25T04:47:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rbd_mirror": "0/5", 2023-01-25T04:47:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rbd_pwl": "0/5", 2023-01-25T04:47:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rbd_replay": "0/5", 2023-01-25T04:47:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_refs": "0/0", 2023-01-25T04:47:55.639 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_reserver": "1/1", 2023-01-25T04:47:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rgw": "1/5", 2023-01-25T04:47:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rgw_access": "1/5", 2023-01-25T04:47:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rgw_datacache": "1/5", 2023-01-25T04:47:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rgw_dbstore": "1/5", 2023-01-25T04:47:55.640 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rgw_flight": "1/5", 2023-01-25T04:47:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rgw_sync": "1/5", 2023-01-25T04:47:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_rocksdb": "4/5", 2023-01-25T04:47:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore": "0/5", 2023-01-25T04:47:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_backref": "0/5", 2023-01-25T04:47:55.641 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_cache": "0/5", 2023-01-25T04:47:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_cleaner": "0/5", 2023-01-25T04:47:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_device": "0/5", 2023-01-25T04:47:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_epm": "0/5", 2023-01-25T04:47:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-01-25T04:47:55.642 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_journal": "0/5", 2023-01-25T04:47:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_lba": "0/5", 2023-01-25T04:47:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_odata": "0/5", 2023-01-25T04:47:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_omap": "0/5", 2023-01-25T04:47:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_onode": "0/5", 2023-01-25T04:47:55.643 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_t": "0/5", 2023-01-25T04:47:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_seastore_tm": "0/5", 2023-01-25T04:47:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_striper": "0/1", 2023-01-25T04:47:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_test": "0/5", 2023-01-25T04:47:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_throttle": "1/1", 2023-01-25T04:47:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_timer": "0/1", 2023-01-25T04:47:55.644 INFO:teuthology.orchestra.run.smithi149.stdout: "debug_tp": "0/5", 2023-01-25T04:47:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "device_failure_prediction_mode": "none", 2023-01-25T04:47:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-01-25T04:47:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-01-25T04:47:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "err_to_graylog": "false", 2023-01-25T04:47:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "err_to_journald": "false", 2023-01-25T04:47:55.645 INFO:teuthology.orchestra.run.smithi149.stdout: "err_to_stderr": "true", 2023-01-25T04:47:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "err_to_syslog": "false", 2023-01-25T04:47:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "event_tracing": "false", 2023-01-25T04:47:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "exporter_addr": "0.0.0.0", 2023-01-25T04:47:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "exporter_http_port": "9926", 2023-01-25T04:47:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "exporter_prio_limit": "5", 2023-01-25T04:47:55.646 INFO:teuthology.orchestra.run.smithi149.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-01-25T04:47:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "exporter_sort_metrics": "true", 2023-01-25T04:47:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "exporter_stats_period": "5", 2023-01-25T04:47:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "fake_statfs_for_testing": "0", 2023-01-25T04:47:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "fatal_signal_handlers": "true", 2023-01-25T04:47:55.647 INFO:teuthology.orchestra.run.smithi149.stdout: "filer_max_purge_ops": "10", 2023-01-25T04:47:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "filer_max_truncate_ops": "128", 2023-01-25T04:47:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_apply_finisher_threads": "1", 2023-01-25T04:47:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_blackhole": "false", 2023-01-25T04:47:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_btrfs_clone_range": "true", 2023-01-25T04:47:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_btrfs_snap": "true", 2023-01-25T04:47:55.648 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_caller_concurrency": "10", 2023-01-25T04:47:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_collect_device_partition_information": "true", 2023-01-25T04:47:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_commit_timeout": "600.000000", 2023-01-25T04:47:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_debug_inject_read_err": "false", 2023-01-25T04:47:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_debug_omap_check": "false", 2023-01-25T04:47:55.649 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_debug_random_read_err": "0.000000", 2023-01-25T04:47:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_debug_verify_split": "false", 2023-01-25T04:47:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_dump_file": "", 2023-01-25T04:47:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-01-25T04:47:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-01-25T04:47:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_fadvise": "true", 2023-01-25T04:47:55.650 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_fail_eio": "true", 2023-01-25T04:47:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_fd_cache_shards": "16", 2023-01-25T04:47:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_fd_cache_size": "128", 2023-01-25T04:47:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_fiemap": "false", 2023-01-25T04:47:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_fiemap_threshold": "4096", 2023-01-25T04:47:55.651 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-01-25T04:47:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_index_retry_probability": "0.000000", 2023-01-25T04:47:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_inject_stall": "0", 2023-01-25T04:47:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_journal_parallel": "false", 2023-01-25T04:47:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_journal_trailing": "false", 2023-01-25T04:47:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_journal_writeahead": "false", 2023-01-25T04:47:55.652 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_kill_at": "0", 2023-01-25T04:47:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-01-25T04:47:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_inline_xattr_size": "0", 2023-01-25T04:47:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-01-25T04:47:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-01-25T04:47:55.653 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-01-25T04:47:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_inline_xattrs": "0", 2023-01-25T04:47:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-01-25T04:47:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_inline_xattrs_other": "2", 2023-01-25T04:47:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-01-25T04:47:55.654 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_sync_interval": "5.000000", 2023-01-25T04:47:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_xattr_value_size": "0", 2023-01-25T04:47:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-01-25T04:47:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-01-25T04:47:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-01-25T04:47:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_merge_threshold": "-10", 2023-01-25T04:47:55.656 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_min_sync_interval": "0.010000", 2023-01-25T04:47:55.656 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_odsync_write": "false", 2023-01-25T04:47:55.656 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_omap_backend": "rocksdb", 2023-01-25T04:47:55.656 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_omap_backend_path": "", 2023-01-25T04:47:55.656 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_omap_header_cache_size": "1024", 2023-01-25T04:47:55.657 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_ondisk_finisher_threads": "1", 2023-01-25T04:47:55.657 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-01-25T04:47:55.657 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_op_thread_timeout": "60", 2023-01-25T04:47:55.657 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_op_threads": "2", 2023-01-25T04:47:55.657 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_punch_hole": "false", 2023-01-25T04:47:55.657 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-01-25T04:47:55.658 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-01-25T04:47:55.658 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-01-25T04:47:55.658 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-01-25T04:47:55.658 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-01-25T04:47:55.658 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_max_bytes": "104857600", 2023-01-25T04:47:55.658 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-01-25T04:47:55.659 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-01-25T04:47:55.659 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-01-25T04:47:55.659 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_queue_max_ops": "50", 2023-01-25T04:47:55.659 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-01-25T04:47:55.659 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_seek_data_hole": "false", 2023-01-25T04:47:55.660 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_sloppy_crc": "false", 2023-01-25T04:47:55.660 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-01-25T04:47:55.660 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_splice": "false", 2023-01-25T04:47:55.660 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_split_multiple": "2", 2023-01-25T04:47:55.660 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_split_rand_factor": "20", 2023-01-25T04:47:55.661 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_update_to": "1000", 2023-01-25T04:47:55.661 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-01-25T04:47:55.661 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-01-25T04:47:55.661 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-01-25T04:47:55.661 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-01-25T04:47:55.661 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-01-25T04:47:55.662 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-01-25T04:47:55.662 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_enable": "true", 2023-01-25T04:47:55.662 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-01-25T04:47:55.662 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-01-25T04:47:55.662 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-01-25T04:47:55.662 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-01-25T04:47:55.663 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-01-25T04:47:55.663 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-01-25T04:47:55.663 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_xfs_extsize": "false", 2023-01-25T04:47:55.663 INFO:teuthology.orchestra.run.smithi149.stdout: "filestore_zfs_snap": "false", 2023-01-25T04:47:55.663 INFO:teuthology.orchestra.run.smithi149.stdout: "fio_dir": "/tmp/fio", 2023-01-25T04:47:55.664 INFO:teuthology.orchestra.run.smithi149.stdout: "fsid": "629f2296-7568-47e9-b1d7-daec4aeb5f55", 2023-01-25T04:47:55.664 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_allow_other": "true", 2023-01-25T04:47:55.664 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_atomic_o_trunc": "true", 2023-01-25T04:47:55.664 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_big_writes": "true", 2023-01-25T04:47:55.664 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_debug": "false", 2023-01-25T04:47:55.665 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_default_permissions": "false", 2023-01-25T04:47:55.665 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_disable_pagecache": "false", 2023-01-25T04:47:55.665 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_max_write": "0", 2023-01-25T04:47:55.665 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_multithreaded": "true", 2023-01-25T04:47:55.666 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_require_active_mds": "true", 2023-01-25T04:47:55.666 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_set_user_groups": "true", 2023-01-25T04:47:55.666 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_splice_move": "true", 2023-01-25T04:47:55.666 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_splice_read": "true", 2023-01-25T04:47:55.666 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_splice_write": "true", 2023-01-25T04:47:55.667 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_syncfs_on_mksnap": "true", 2023-01-25T04:47:55.667 INFO:teuthology.orchestra.run.smithi149.stdout: "fuse_use_invalidate_cb": "true", 2023-01-25T04:47:55.667 INFO:teuthology.orchestra.run.smithi149.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-01-25T04:47:55.667 INFO:teuthology.orchestra.run.smithi149.stdout: "gss_target_name": "ceph", 2023-01-25T04:47:55.667 INFO:teuthology.orchestra.run.smithi149.stdout: "heartbeat_file": "", 2023-01-25T04:47:55.668 INFO:teuthology.orchestra.run.smithi149.stdout: "heartbeat_inject_failure": "0", 2023-01-25T04:47:55.668 INFO:teuthology.orchestra.run.smithi149.stdout: "heartbeat_interval": "5", 2023-01-25T04:47:55.668 INFO:teuthology.orchestra.run.smithi149.stdout: "host": "smithi149", 2023-01-25T04:47:55.668 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-01-25T04:47:55.668 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-01-25T04:47:55.669 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_max_size": "1073741824", 2023-01-25T04:47:55.669 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-01-25T04:47:55.669 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-01-25T04:47:55.669 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-01-25T04:47:55.669 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-01-25T04:47:55.670 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-01-25T04:47:55.670 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-01-25T04:47:55.670 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-01-25T04:47:55.670 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-01-25T04:47:55.670 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-01-25T04:47:55.671 INFO:teuthology.orchestra.run.smithi149.stdout: "immutable_object_cache_watermark": "0.900000", 2023-01-25T04:47:55.671 INFO:teuthology.orchestra.run.smithi149.stdout: "inject_early_sigterm": "false", 2023-01-25T04:47:55.671 INFO:teuthology.orchestra.run.smithi149.stdout: "jaeger_tracing_enable": "false", 2023-01-25T04:47:55.671 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_aio": "true", 2023-01-25T04:47:55.671 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_align_min_size": "65536", 2023-01-25T04:47:55.672 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_block_align": "true", 2023-01-25T04:47:55.672 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_block_size": "4096", 2023-01-25T04:47:55.672 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_dio": "true", 2023-01-25T04:47:55.672 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_discard": "false", 2023-01-25T04:47:55.672 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_force_aio": "false", 2023-01-25T04:47:55.673 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_ignore_corruption": "false", 2023-01-25T04:47:55.673 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_max_write_bytes": "10485760", 2023-01-25T04:47:55.673 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_max_write_entries": "100", 2023-01-25T04:47:55.673 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_replay_from": "0", 2023-01-25T04:47:55.673 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_throttle_high_multiple": "0.000000", 2023-01-25T04:47:55.674 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-01-25T04:47:55.674 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-01-25T04:47:55.674 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_throttle_max_multiple": "0.000000", 2023-01-25T04:47:55.674 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_write_header_frequency": "0", 2023-01-25T04:47:55.674 INFO:teuthology.orchestra.run.smithi149.stdout: "journal_zero_on_create": "false", 2023-01-25T04:47:55.675 INFO:teuthology.orchestra.run.smithi149.stdout: "journaler_prefetch_periods": "10", 2023-01-25T04:47:55.675 INFO:teuthology.orchestra.run.smithi149.stdout: "journaler_prezero_periods": "5", 2023-01-25T04:47:55.675 INFO:teuthology.orchestra.run.smithi149.stdout: "journaler_write_head_interval": "15", 2023-01-25T04:47:55.675 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "", 2023-01-25T04:47:55.675 INFO:teuthology.orchestra.run.smithi149.stdout: "keyfile": "", 2023-01-25T04:47:55.676 INFO:teuthology.orchestra.run.smithi149.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-01-25T04:47:55.676 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_backend": "rocksdb", 2023-01-25T04:47:55.676 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_default_stripe_size": "65536", 2023-01-25T04:47:55.676 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_fsck_on_mount": "false", 2023-01-25T04:47:55.676 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_fsck_on_mount_deep": "true", 2023-01-25T04:47:55.677 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_max_bytes": "67108864", 2023-01-25T04:47:55.677 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_max_ops": "512", 2023-01-25T04:47:55.677 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_nid_prealloc": "1024", 2023-01-25T04:47:55.677 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_onode_map_size": "1024", 2023-01-25T04:47:55.677 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-01-25T04:47:55.678 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_sync_submit_transaction": "false", 2023-01-25T04:47:55.678 INFO:teuthology.orchestra.run.smithi149.stdout: "kstore_sync_transaction": "false", 2023-01-25T04:47:55.678 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_block_size": "65536", 2023-01-25T04:47:55.678 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_bloom_size": "0", 2023-01-25T04:47:55.678 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_cache_size": "536870912", 2023-01-25T04:47:55.678 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_compact_on_mount": "false", 2023-01-25T04:47:55.679 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_compression": "false", 2023-01-25T04:47:55.679 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_log": "", 2023-01-25T04:47:55.679 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_log_to_ceph_log": "true", 2023-01-25T04:47:55.679 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_max_open_files": "0", 2023-01-25T04:47:55.679 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_paranoid": "false", 2023-01-25T04:47:55.680 INFO:teuthology.orchestra.run.smithi149.stdout: "leveldb_write_buffer_size": "33554432", 2023-01-25T04:47:55.680 INFO:teuthology.orchestra.run.smithi149.stdout: "librados_thread_count": "2", 2023-01-25T04:47:55.680 INFO:teuthology.orchestra.run.smithi149.stdout: "lockdep": "false", 2023-01-25T04:47:55.680 INFO:teuthology.orchestra.run.smithi149.stdout: "lockdep_force_backtrace": "false", 2023-01-25T04:47:55.680 INFO:teuthology.orchestra.run.smithi149.stdout: "log_coarse_timestamps": "true", 2023-01-25T04:47:55.681 INFO:teuthology.orchestra.run.smithi149.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-01-25T04:47:55.681 INFO:teuthology.orchestra.run.smithi149.stdout: "log_flush_on_exit": "false", 2023-01-25T04:47:55.681 INFO:teuthology.orchestra.run.smithi149.stdout: "log_graylog_host": "127.0.0.1", 2023-01-25T04:47:55.681 INFO:teuthology.orchestra.run.smithi149.stdout: "log_graylog_port": "12201", 2023-01-25T04:47:55.681 INFO:teuthology.orchestra.run.smithi149.stdout: "log_max_new": "1000", 2023-01-25T04:47:55.681 INFO:teuthology.orchestra.run.smithi149.stdout: "log_max_recent": "10000", 2023-01-25T04:47:55.682 INFO:teuthology.orchestra.run.smithi149.stdout: "log_stderr_prefix": "", 2023-01-25T04:47:55.682 INFO:teuthology.orchestra.run.smithi149.stdout: "log_stop_at_utilization": "0.970000", 2023-01-25T04:47:55.682 INFO:teuthology.orchestra.run.smithi149.stdout: "log_to_file": "true", 2023-01-25T04:47:55.682 INFO:teuthology.orchestra.run.smithi149.stdout: "log_to_graylog": "false", 2023-01-25T04:47:55.682 INFO:teuthology.orchestra.run.smithi149.stdout: "log_to_journald": "false", 2023-01-25T04:47:55.683 INFO:teuthology.orchestra.run.smithi149.stdout: "log_to_stderr": "false", 2023-01-25T04:47:55.683 INFO:teuthology.orchestra.run.smithi149.stdout: "log_to_syslog": "false", 2023-01-25T04:47:55.683 INFO:teuthology.orchestra.run.smithi149.stdout: "max_rotating_auth_attempts": "10", 2023-01-25T04:47:55.683 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_action_on_write_error": "1", 2023-01-25T04:47:55.683 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_alternate_name_max": "8192", 2023-01-25T04:47:55.684 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_asio_thread_count": "2", 2023-01-25T04:47:55.684 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_export_pin": "true", 2023-01-25T04:47:55.684 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_fragment_dirs": "true", 2023-01-25T04:47:55.684 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-01-25T04:47:55.684 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_fragment_interval": "5", 2023-01-25T04:47:55.685 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_fragment_size_max": "100000", 2023-01-25T04:47:55.685 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_idle_threshold": "0.000000", 2023-01-25T04:47:55.685 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_interval": "10", 2023-01-25T04:47:55.685 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_max": "-1", 2023-01-25T04:47:55.685 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_max_until": "-1", 2023-01-25T04:47:55.685 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_merge_size": "50", 2023-01-25T04:47:55.686 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_midchunk": "0.300000", 2023-01-25T04:47:55.686 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_min_rebalance": "0.100000", 2023-01-25T04:47:55.686 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_min_start": "0.200000", 2023-01-25T04:47:55.686 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_minchunk": "0.001000", 2023-01-25T04:47:55.686 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_mode": "0", 2023-01-25T04:47:55.686 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_need_max": "1.200000", 2023-01-25T04:47:55.687 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_need_min": "0.800000", 2023-01-25T04:47:55.687 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-01-25T04:47:55.687 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_sample_interval": "3.000000", 2023-01-25T04:47:55.687 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_split_bits": "3", 2023-01-25T04:47:55.687 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_split_rd": "25000.000000", 2023-01-25T04:47:55.688 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_split_size": "10000", 2023-01-25T04:47:55.688 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_split_wr": "10000.000000", 2023-01-25T04:47:55.688 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_target_decay": "10.000000", 2023-01-25T04:47:55.688 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-01-25T04:47:55.688 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_beacon_grace": "15.000000", 2023-01-25T04:47:55.689 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_beacon_interval": "4.000000", 2023-01-25T04:47:55.689 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_beacon_mon_down_grace": "60", 2023-01-25T04:47:55.689 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache_memory_limit": "4294967296", 2023-01-25T04:47:55.689 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache_mid": "0.700000", 2023-01-25T04:47:55.689 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache_release_free_interval": "10", 2023-01-25T04:47:55.689 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache_reservation": "0.050000", 2023-01-25T04:47:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-01-25T04:47:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache_trim_interval": "1", 2023-01-25T04:47:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache_trim_threshold": "262144", 2023-01-25T04:47:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-01-25T04:47:55.690 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-01-25T04:47:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_client_delegate_inos_pct": "50", 2023-01-25T04:47:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_client_prealloc_inos": "1000", 2023-01-25T04:47:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-01-25T04:47:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_connect_bootstrapping": "false", 2023-01-25T04:47:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_damage_table_max_entries": "10000", 2023-01-25T04:47:55.691 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-01-25T04:47:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_debug_auth_pins": "false", 2023-01-25T04:47:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_debug_frag": "false", 2023-01-25T04:47:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_debug_scatterstat": "false", 2023-01-25T04:47:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_debug_subtrees": "false", 2023-01-25T04:47:55.692 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_decay_halflife": "5.000000", 2023-01-25T04:47:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_default_dir_hash": "2", 2023-01-25T04:47:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_defer_session_stale": "true", 2023-01-25T04:47:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_deny_all_reconnect": "false", 2023-01-25T04:47:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dir_keys_per_op": "16384", 2023-01-25T04:47:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dir_max_commit_size": "10", 2023-01-25T04:47:55.693 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dir_max_entries": "0", 2023-01-25T04:47:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dir_prefetch": "true", 2023-01-25T04:47:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dirstat_min_interval": "1.000000", 2023-01-25T04:47:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dump_cache_after_rejoin": "false", 2023-01-25T04:47:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dump_cache_on_map": "false", 2023-01-25T04:47:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dump_cache_threshold_file": "0", 2023-01-25T04:47:55.694 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-01-25T04:47:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_early_reply": "true", 2023-01-25T04:47:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_enable_op_tracker": "true", 2023-01-25T04:47:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_enforce_unique_name": "true", 2023-01-25T04:47:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_export_ephemeral_distributed": "true", 2023-01-25T04:47:55.695 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-01-25T04:47:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_export_ephemeral_random": "true", 2023-01-25T04:47:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-01-25T04:47:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-01-25T04:47:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_forward_all_requests_to_auth": "false", 2023-01-25T04:47:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-01-25T04:47:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-01-25T04:47:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-01-25T04:47:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_health_cache_threshold": "1.500000", 2023-01-25T04:47:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_health_summarize_threshold": "10", 2023-01-25T04:47:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_heartbeat_grace": "15.000000", 2023-01-25T04:47:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_heartbeat_reset_grace": "1000", 2023-01-25T04:47:55.697 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_inject_health_dummy": "false", 2023-01-25T04:47:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_inject_migrator_session_race": "false", 2023-01-25T04:47:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-01-25T04:47:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_join_fs": "", 2023-01-25T04:47:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_journal_format": "1", 2023-01-25T04:47:55.698 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_create_at": "0", 2023-01-25T04:47:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_export_at": "0", 2023-01-25T04:47:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_import_at": "0", 2023-01-25T04:47:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_journal_at": "0", 2023-01-25T04:47:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_journal_expire_at": "0", 2023-01-25T04:47:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_journal_replay_at": "0", 2023-01-25T04:47:55.699 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_link_at": "0", 2023-01-25T04:47:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_mdstable_at": "0", 2023-01-25T04:47:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_openc_at": "0", 2023-01-25T04:47:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_kill_rename_at": "0", 2023-01-25T04:47:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log_events_per_segment": "1024", 2023-01-25T04:47:55.700 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log_max_events": "-1", 2023-01-25T04:47:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log_max_segments": "128", 2023-01-25T04:47:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log_pause": "false", 2023-01-25T04:47:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log_segment_size": "0", 2023-01-25T04:47:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log_skip_corrupt_events": "false", 2023-01-25T04:47:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log_warn_factor": "2.000000", 2023-01-25T04:47:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_caps_per_client": "1048576", 2023-01-25T04:47:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_completed_flushes": "100000", 2023-01-25T04:47:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_completed_requests": "100000", 2023-01-25T04:47:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_export_size": "20971520", 2023-01-25T04:47:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_file_recover": "32", 2023-01-25T04:47:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_purge_files": "64", 2023-01-25T04:47:55.702 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_purge_ops": "8192", 2023-01-25T04:47:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-01-25T04:47:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_retries_on_remount_failure": "5", 2023-01-25T04:47:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-01-25T04:47:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_snaps_per_dir": "100", 2023-01-25T04:47:55.703 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_max_xattr_pairs_size": "65536", 2023-01-25T04:47:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_metrics_update_interval": "2", 2023-01-25T04:47:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_min_caps_per_client": "100", 2023-01-25T04:47:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_min_caps_working_set": "10000", 2023-01-25T04:47:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-01-25T04:47:55.704 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_numa_node": "-1", 2023-01-25T04:47:55.705 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-01-25T04:47:55.705 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_op_complaint_time": "30.000000", 2023-01-25T04:47:55.705 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_op_history_duration": "600", 2023-01-25T04:47:55.705 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_op_history_size": "20", 2023-01-25T04:47:55.705 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_op_log_threshold": "5", 2023-01-25T04:47:55.705 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_ping_grace": "15", 2023-01-25T04:47:55.706 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_ping_interval": "5", 2023-01-25T04:47:55.706 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-01-25T04:47:55.706 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-01-25T04:47:55.706 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_recall_max_caps": "30000", 2023-01-25T04:47:55.706 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-01-25T04:47:55.707 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_recall_max_decay_threshold": "131072", 2023-01-25T04:47:55.707 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-01-25T04:47:55.707 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_recall_warning_threshold": "262144", 2023-01-25T04:47:55.707 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_reconnect_timeout": "45.000000", 2023-01-25T04:47:55.707 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_replay_interval": "1.000000", 2023-01-25T04:47:55.708 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-01-25T04:47:55.708 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-01-25T04:47:55.708 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_root_ino_gid": "0", 2023-01-25T04:47:55.708 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_root_ino_uid": "0", 2023-01-25T04:47:55.708 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-01-25T04:47:55.709 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_session_blocklist_on_evict": "true", 2023-01-25T04:47:55.709 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_session_blocklist_on_timeout": "true", 2023-01-25T04:47:55.709 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-01-25T04:47:55.709 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-01-25T04:47:55.709 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-01-25T04:47:55.709 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-01-25T04:47:55.710 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-01-25T04:47:55.710 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-01-25T04:47:55.710 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_shutdown_check": "0", 2023-01-25T04:47:55.710 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_skip_ino": "0", 2023-01-25T04:47:55.710 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sleep_rank_change": "0.000000", 2023-01-25T04:47:55.710 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_snap_max_uid": "4294967294", 2023-01-25T04:47:55.711 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_snap_min_uid": "0", 2023-01-25T04:47:55.711 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_snap_rstat": "false", 2023-01-25T04:47:55.711 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_standby_replay_damaged": "false", 2023-01-25T04:47:55.711 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_symlink_recovery": "true", 2023-01-25T04:47:55.711 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_task_status_update_interval": "2.000000", 2023-01-25T04:47:55.711 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_thrash_exports": "0", 2023-01-25T04:47:55.712 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_thrash_fragments": "0", 2023-01-25T04:47:55.712 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_tick_interval": "5.000000", 2023-01-25T04:47:55.712 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_valgrind_exit": "false", 2023-01-25T04:47:55.712 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_verify_backtrace": "1", 2023-01-25T04:47:55.712 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_verify_scatter": "false", 2023-01-25T04:47:55.712 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_wipe_ino_prealloc": "false", 2023-01-25T04:47:55.713 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_wipe_sessions": "false", 2023-01-25T04:47:55.713 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool_debug": "false", 2023-01-25T04:47:55.713 INFO:teuthology.orchestra.run.smithi149.stdout: "memstore_debug_omit_block_device_write": "false", 2023-01-25T04:47:55.713 INFO:teuthology.orchestra.run.smithi149.stdout: "memstore_device_bytes": "1073741824", 2023-01-25T04:47:55.713 INFO:teuthology.orchestra.run.smithi149.stdout: "memstore_page_set": "false", 2023-01-25T04:47:55.714 INFO:teuthology.orchestra.run.smithi149.stdout: "memstore_page_size": "65536", 2023-01-25T04:47:55.714 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_client_bytes": "134217728", 2023-01-25T04:47:55.714 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_client_messages": "512", 2023-01-25T04:47:55.714 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-01-25T04:47:55.714 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_connect_retry_interval": "1.000000", 2023-01-25T04:47:55.714 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-01-25T04:47:55.715 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-01-25T04:47:55.715 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_disabled_modules": "", 2023-01-25T04:47:55.715 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-01-25T04:47:55.715 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_max_pg_num_change": "128", 2023-01-25T04:47:55.715 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_mds_bytes": "134217728", 2023-01-25T04:47:55.715 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_mds_messages": "128", 2023-01-25T04:47:55.716 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-01-25T04:47:55.716 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_mon_bytes": "134217728", 2023-01-25T04:47:55.716 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_mon_messages": "128", 2023-01-25T04:47:55.716 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_osd_bytes": "536870912", 2023-01-25T04:47:55.716 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_osd_messages": "8192", 2023-01-25T04:47:55.717 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_pool": "true", 2023-01-25T04:47:55.717 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_service_beacon_grace": "60.000000", 2023-01-25T04:47:55.717 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_standby_modules": "true", 2023-01-25T04:47:55.717 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_stats_period": "5", 2023-01-25T04:47:55.717 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_stats_threshold": "5", 2023-01-25T04:47:55.717 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_tick_period": "2", 2023-01-25T04:47:55.718 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-01-25T04:47:55.718 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_accept_timeout_factor": "2.000000", 2023-01-25T04:47:55.718 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_allow_pool_delete": "true", 2023-01-25T04:47:55.718 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_allow_pool_size_one": "true", 2023-01-25T04:47:55.718 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_auth_validate_all_caps": "true", 2023-01-25T04:47:55.718 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-01-25T04:47:55.719 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-01-25T04:47:55.719 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_bytes": "104857600", 2023-01-25T04:47:55.719 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_directed_command_retry": "5", 2023-01-25T04:47:55.719 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_hunt_interval": "3.000000", 2023-01-25T04:47:55.719 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-01-25T04:47:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-01-25T04:47:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-01-25T04:47:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_hunt_parallel": "3", 2023-01-25T04:47:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_log_interval": "1.000000", 2023-01-25T04:47:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-01-25T04:47:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_ping_interval": "10.000000", 2023-01-25T04:47:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_client_ping_timeout": "30.000000", 2023-01-25T04:47:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_clock_drift_allowed": "1.000000", 2023-01-25T04:47:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-01-25T04:47:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-01-25T04:47:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_file_level": "debug", 2023-01-25T04:47:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_file": "true", 2023-01-25T04:47:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_graylog": "false", 2023-01-25T04:47:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-01-25T04:47:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-01-25T04:47:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_journald": "false", 2023-01-25T04:47:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_stderr": "false", 2023-01-25T04:47:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-01-25T04:47:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-01-25T04:47:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-01-25T04:47:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_compact_on_bootstrap": "false", 2023-01-25T04:47:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_compact_on_start": "false", 2023-01-25T04:47:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_compact_on_trim": "true", 2023-01-25T04:47:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_con_tracker_persist_interval": "10", 2023-01-25T04:47:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_con_tracker_score_halflife": "43200", 2023-01-25T04:47:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_config_key_max_entry_size": "65536", 2023-01-25T04:47:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_cpu_threads": "4", 2023-01-25T04:47:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_crush_min_required_version": "hammer", 2023-01-25T04:47:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_daemon_bytes": "419430400", 2023-01-25T04:47:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-01-25T04:47:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_data_avail_crit": "5", 2023-01-25T04:47:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_data_avail_warn": "5", 2023-01-25T04:47:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_data_size_warn": "16106127360", 2023-01-25T04:47:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_block_osdmap_trim": "false", 2023-01-25T04:47:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-01-25T04:47:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_dump_json": "false", 2023-01-25T04:47:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-01-25T04:47:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_dump_transactions": "false", 2023-01-25T04:47:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_extra_checks": "false", 2023-01-25T04:47:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-01-25T04:47:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-01-25T04:47:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_no_require_quincy": "false", 2023-01-25T04:47:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_no_require_reef": "false", 2023-01-25T04:47:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-01-25T04:47:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_delta_reset_interval": "10.000000", 2023-01-25T04:47:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_dns_srv_name": "ceph-mon", 2023-01-25T04:47:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_down_mkfs_grace": "120", 2023-01-25T04:47:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_election_default_strategy": "3", 2023-01-25T04:47:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_election_timeout": "5.000000", 2023-01-25T04:47:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-01-25T04:47:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_elector_ping_divisor": "2", 2023-01-25T04:47:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_elector_ping_timeout": "2.000000", 2023-01-25T04:47:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_enable_op_tracker": "true", 2023-01-25T04:47:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_fake_pool_delete": "false", 2023-01-25T04:47:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_force_quorum_join": "false", 2023-01-25T04:47:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_globalid_prealloc": "10000", 2023-01-25T04:47:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_health_detail_to_clog": "false", 2023-01-25T04:47:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_health_log_update_period": "5", 2023-01-25T04:47:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_health_max_detail": "50", 2023-01-25T04:47:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_health_to_clog": "true", 2023-01-25T04:47:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_health_to_clog_interval": "600", 2023-01-25T04:47:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-01-25T04:47:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_host": "172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790],172.21.15.154", 2023-01-25T04:47:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_host_override": "", 2023-01-25T04:47:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_initial_members": "", 2023-01-25T04:47:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-01-25T04:47:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-01-25T04:47:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-01-25T04:47:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-01-25T04:47:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_keyvaluedb": "rocksdb", 2023-01-25T04:47:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_lease": "5.000000", 2023-01-25T04:47:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-01-25T04:47:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-01-25T04:47:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_log_full_interval": "50", 2023-01-25T04:47:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_log_max": "10000", 2023-01-25T04:47:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_log_max_summary": "50", 2023-01-25T04:47:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_max_log_entries_per_event": "4096", 2023-01-25T04:47:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_max_log_epochs": "500", 2023-01-25T04:47:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_max_mdsmap_epochs": "500", 2023-01-25T04:47:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_max_mgrmap_epochs": "500", 2023-01-25T04:47:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_max_osd": "10000", 2023-01-25T04:47:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_max_pg_per_osd": "10000", 2023-01-25T04:47:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_max_pool_pg_num": "65536", 2023-01-25T04:47:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-01-25T04:47:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-01-25T04:47:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mds_force_trim_to": "0", 2023-01-25T04:47:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mds_skip_sanity": "false", 2023-01-25T04:47:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_memory_autotune": "true", 2023-01-25T04:47:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_memory_target": "2147483648", 2023-01-25T04:47:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mgr_beacon_grace": "30", 2023-01-25T04:47:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-01-25T04:47:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mgr_digest_period": "5", 2023-01-25T04:47:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mgr_inactive_grace": "60", 2023-01-25T04:47:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mgr_mkfs_grace": "240", 2023-01-25T04:47:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-01-25T04:47:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_min_osdmap_epochs": "50", 2023-01-25T04:47:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_op_complaint_time": "30", 2023-01-25T04:47:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_op_history_duration": "600", 2023-01-25T04:47:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_op_history_size": "20", 2023-01-25T04:47:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_op_history_slow_op_size": "20", 2023-01-25T04:47:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_op_history_slow_op_threshold": "10", 2023-01-25T04:47:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_op_log_threshold": "5", 2023-01-25T04:47:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-01-25T04:47:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-01-25T04:47:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-01-25T04:47:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_auto_mark_in": "false", 2023-01-25T04:47:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_auto_mark_new_in": "true", 2023-01-25T04:47:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-01-25T04:47:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-01-25T04:47:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_cache_size": "500", 2023-01-25T04:47:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_cache_size_min": "134217728", 2023-01-25T04:47:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_crush_smoke_test": "true", 2023-01-25T04:47:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_destroyed_out_interval": "600", 2023-01-25T04:47:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_down_out_interval": "600", 2023-01-25T04:47:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-01-25T04:47:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-01-25T04:47:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_force_trim_to": "0", 2023-01-25T04:47:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_full_ratio": "0.950000", 2023-01-25T04:47:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-01-25T04:47:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_laggy_halflife": "3600", 2023-01-25T04:47:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_laggy_max_interval": "300", 2023-01-25T04:47:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_laggy_weight": "0.300000", 2023-01-25T04:47:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-01-25T04:47:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_max_creating_pgs": "1024", 2023-01-25T04:47:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_max_initial_pgs": "1024", 2023-01-25T04:47:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_min_down_reporters": "2", 2023-01-25T04:47:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-01-25T04:47:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-01-25T04:47:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-01-25T04:47:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_prime_pg_temp": "true", 2023-01-25T04:47:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-01-25T04:47:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-01-25T04:47:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_report_timeout": "900", 2023-01-25T04:47:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-01-25T04:47:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-01-25T04:47:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_warn_num_repaired": "10", 2023-01-25T04:47:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osd_warn_op_age": "32.000000", 2023-01-25T04:47:55.745 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-01-25T04:47:55.745 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osdmap_full_prune_interval": "2", 2023-01-25T04:47:55.745 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osdmap_full_prune_min": "15", 2023-01-25T04:47:55.745 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_osdmap_full_prune_txsize": "2", 2023-01-25T04:47:55.745 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-01-25T04:47:55.745 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_pg_stuck_threshold": "60", 2023-01-25T04:47:55.746 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-01-25T04:47:55.746 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_pg_warn_min_objects": "10000", 2023-01-25T04:47:55.746 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_pg_warn_min_per_osd": "0", 2023-01-25T04:47:55.746 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-01-25T04:47:55.746 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_pool_quota_crit_threshold": "0", 2023-01-25T04:47:55.746 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_pool_quota_warn_threshold": "0", 2023-01-25T04:47:55.747 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_probe_timeout": "2.000000", 2023-01-25T04:47:55.747 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_reweight_max_change": "0.050000", 2023-01-25T04:47:55.747 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_reweight_max_osds": "4", 2023-01-25T04:47:55.747 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-01-25T04:47:55.747 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-01-25T04:47:55.747 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-01-25T04:47:55.748 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-01-25T04:47:55.748 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-01-25T04:47:55.748 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_scrub_interval": "300", 2023-01-25T04:47:55.748 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_scrub_max_keys": "100", 2023-01-25T04:47:55.748 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_scrub_timeout": "300", 2023-01-25T04:47:55.749 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_session_timeout": "300", 2023-01-25T04:47:55.749 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_smart_report_timeout": "5", 2023-01-25T04:47:55.749 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_stat_smooth_intervals": "6", 2023-01-25T04:47:55.749 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-01-25T04:47:55.749 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_stretch_pool_min_size": "2", 2023-01-25T04:47:55.750 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_stretch_pool_size": "4", 2023-01-25T04:47:55.750 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-01-25T04:47:55.750 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_subscribe_interval": "86400.000000", 2023-01-25T04:47:55.750 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_sync_debug": "false", 2023-01-25T04:47:55.750 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_sync_max_payload_keys": "2000", 2023-01-25T04:47:55.751 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_sync_max_payload_size": "1048576", 2023-01-25T04:47:55.751 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_sync_provider_kill_at": "0", 2023-01-25T04:47:55.751 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_sync_requester_kill_at": "0", 2023-01-25T04:47:55.751 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_sync_timeout": "60.000000", 2023-01-25T04:47:55.751 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_target_pg_per_osd": "100", 2023-01-25T04:47:55.751 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_tick_interval": "5", 2023-01-25T04:47:55.752 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_timecheck_interval": "300.000000", 2023-01-25T04:47:55.752 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-01-25T04:47:55.752 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_use_min_delay_socket": "false", 2023-01-25T04:47:55.752 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_older_version_delay": "604800", 2023-01-25T04:47:55.752 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-01-25T04:47:55.753 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-01-25T04:47:55.753 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-01-25T04:47:55.753 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_filestore_osds": "false", 2023-01-25T04:47:55.753 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-01-25T04:47:55.753 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-01-25T04:47:55.754 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-01-25T04:47:55.754 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_misplaced": "false", 2023-01-25T04:47:55.754 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-01-25T04:47:55.754 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_older_version": "true", 2023-01-25T04:47:55.754 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-01-25T04:47:55.754 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_pool_no_app": "true", 2023-01-25T04:47:55.755 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-01-25T04:47:55.755 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-01-25T04:47:55.755 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-01-25T04:47:55.755 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-01-25T04:47:55.755 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_on_too_few_osds": "false", 2023-01-25T04:47:55.756 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-01-25T04:47:55.756 INFO:teuthology.orchestra.run.smithi149.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-01-25T04:47:55.756 INFO:teuthology.orchestra.run.smithi149.stdout: "monmap": "", 2023-01-25T04:47:55.756 INFO:teuthology.orchestra.run.smithi149.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-01-25T04:47:55.756 INFO:teuthology.orchestra.run.smithi149.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-01-25T04:47:55.757 INFO:teuthology.orchestra.run.smithi149.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-01-25T04:47:55.757 INFO:teuthology.orchestra.run.smithi149.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-01-25T04:47:55.757 INFO:teuthology.orchestra.run.smithi149.stdout: "motr_tracing_enabled": "false", 2023-01-25T04:47:55.757 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_op_threads": "3", 2023-01-25T04:47:55.757 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_buffer_size": "131072", 2023-01-25T04:47:55.758 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_cm": "false", 2023-01-25T04:47:55.758 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_device_name": "", 2023-01-25T04:47:55.758 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_dscp": "96", 2023-01-25T04:47:55.758 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-01-25T04:47:55.758 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_gid_idx": "0", 2023-01-25T04:47:55.759 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_local_gid": "", 2023-01-25T04:47:55.759 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_polling_us": "1000", 2023-01-25T04:47:55.759 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_port_num": "1", 2023-01-25T04:47:55.759 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-01-25T04:47:55.759 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-01-25T04:47:55.759 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_roce_ver": "1", 2023-01-25T04:47:55.760 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_send_buffers": "1024", 2023-01-25T04:47:55.760 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_sl": "3", 2023-01-25T04:47:55.760 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_support_srq": "true", 2023-01-25T04:47:55.760 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_rdma_type": "ib", 2023-01-25T04:47:55.760 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_async_reap_threshold": "5", 2023-01-25T04:47:55.761 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_before_connect": "false", 2023-01-25T04:47:55.761 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_ipv4": "true", 2023-01-25T04:47:55.761 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_ipv6": "false", 2023-01-25T04:47:55.761 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_msgr1": "false", 2023-01-25T04:47:55.761 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_msgr2": "true", 2023-01-25T04:47:55.762 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_port_max": "7568", 2023-01-25T04:47:55.762 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_port_min": "6800", 2023-01-25T04:47:55.762 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_prefer_ipv4": "false", 2023-01-25T04:47:55.762 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_retry_count": "3", 2023-01-25T04:47:55.762 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_bind_retry_delay": "5", 2023-01-25T04:47:55.762 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_blackhole_client": "false", 2023-01-25T04:47:55.763 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_blackhole_mds": "false", 2023-01-25T04:47:55.763 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_blackhole_mgr": "false", 2023-01-25T04:47:55.763 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_blackhole_mon": "false", 2023-01-25T04:47:55.763 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_blackhole_osd": "false", 2023-01-25T04:47:55.763 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_client_mode": "crc secure", 2023-01-25T04:47:55.764 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_cluster_mode": "crc secure", 2023-01-25T04:47:55.764 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_cluster_type": "", 2023-01-25T04:47:55.764 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_compress_secure": "false", 2023-01-25T04:47:55.764 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_connection_idle_timeout": "900", 2023-01-25T04:47:55.764 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_connection_ready_timeout": "10", 2023-01-25T04:47:55.765 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_crc_data": "true", 2023-01-25T04:47:55.765 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_crc_header": "true", 2023-01-25T04:47:55.765 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_die_on_bad_msg": "false", 2023-01-25T04:47:55.765 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_die_on_bug": "true", 2023-01-25T04:47:55.765 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_die_on_old_message": "true", 2023-01-25T04:47:55.765 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_die_on_skipped_message": "false", 2023-01-25T04:47:55.766 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_die_on_unhandled_msg": "false", 2023-01-25T04:47:55.766 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-01-25T04:47:55.766 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_coremask": "0xF", 2023-01-25T04:47:55.766 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-01-25T04:47:55.766 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_devs_allowlist": "", 2023-01-25T04:47:55.767 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_enable_tso": "true", 2023-01-25T04:47:55.767 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-01-25T04:47:55.767 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-01-25T04:47:55.767 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_hugepages": "", 2023-01-25T04:47:55.767 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_hw_flow_control": "true", 2023-01-25T04:47:55.768 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-01-25T04:47:55.768 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_lro": "true", 2023-01-25T04:47:55.768 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_memory_channel": "4", 2023-01-25T04:47:55.768 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-01-25T04:47:55.768 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_pmd": "", 2023-01-25T04:47:55.768 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_port_id": "0", 2023-01-25T04:47:55.769 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-01-25T04:47:55.769 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dump_corrupt_message_level": "1", 2023-01-25T04:47:55.769 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_dump_on_send": "false", 2023-01-25T04:47:55.769 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_initial_backoff": "0.200000", 2023-01-25T04:47:55.769 INFO:teuthology.orchestra.run.smithi149.stdout: "ms_inject_delay_max": "1.000000", 2023-01-25T04:47:55.770 INFO:teuthology.orchestra.run.smithi149.stdout: