2023-01-25T09:08:58.865 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T09:08:58.866 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137154 --verbose --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} -- /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137154/orig.config.yaml 2023-01-25T09:08:58.917 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T09:08:58.996 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137154 branch: wip-yuri6-testing-2023-01-24-0746 description: rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} email: yweinstein@radhat.com first_in_suite: false job_id: '7137154' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 - machine: ram: 15000 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri6-testing-2023-01-24-0746 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 osd_recovery_max_active: 10 osd_recovery_max_single_start: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd max scrubs: 2 osd mclock override recovery settings: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - must scrub before tier agent can activate sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 min_in: 4 workunit: branch: wip-yuri6-testing-2023-01-24-0746 sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri6-testing-2023-01-24-0746 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c targets: smithi019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: bluestore_new_sharding: random chance_bluestore_reshard: 1 chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 timeout: 1200 - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 3600 - sudo ceph osd pool set cache target_max_objects 250 - sudo ceph osd pool set cache min_read_recency_for_promote 0 - sudo ceph osd pool set cache min_write_recency_for_promote 0 - rados: clients: - client.0 objects: 500 op_weights: cache_evict: 50 cache_flush: 50 cache_try_flush: 50 copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 pool_snaps: true pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:27:30 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T09:08:58.997 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa; will attempt to use it 2023-01-25T09:08:58.998 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa/tasks 2023-01-25T09:08:58.998 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T09:08:59.000 INFO:teuthology.task.internal:Checking packages... 2023-01-25T09:08:59.028 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '44e4095da12a8269eb6cfe163cbb0d00b1a6412c' 2023-01-25T09:08:59.029 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T09:08:59.029 INFO:teuthology.packaging:ref: None 2023-01-25T09:08:59.029 INFO:teuthology.packaging:tag: None 2023-01-25T09:08:59.030 INFO:teuthology.packaging:branch: wip-yuri6-testing-2023-01-24-0746 2023-01-25T09:08:59.030 INFO:teuthology.packaging:sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:08:59.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri6-testing-2023-01-24-0746 2023-01-25T09:08:59.353 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:08:59.353 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T09:08:59.361 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T09:08:59.361 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T09:08:59.402 INFO:teuthology.task.internal:Saving configuration 2023-01-25T09:08:59.422 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T09:08:59.427 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T09:08:59.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 09:03:06.139726', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-01-25T09:08:59.472 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 09:03:06.138040', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-01-25T09:08:59.472 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T09:08:59.484 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-25T09:08:59.485 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-25T09:08:59.485 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T09:08:59.560 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7f496c15e0>, signals=[15]) 2023-01-25T09:08:59.561 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T09:08:59.568 INFO:teuthology.task.internal:Opening connections... 2023-01-25T09:08:59.568 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2023-01-25T09:08:59.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:08:59.625 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2023-01-25T09:08:59.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:08:59.678 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T09:08:59.686 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-01-25T09:08:59.708 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-01-25T09:08:59.708 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-01-25T09:08:59.756 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu" 2023-01-25T09:08:59.756 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-25T09:08:59.757 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu 2023-01-25T09:08:59.757 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian 2023-01-25T09:08:59.757 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-25T09:08:59.757 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="20.04" 2023-01-25T09:08:59.757 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-25T09:08:59.758 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-25T09:08:59.758 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-25T09:08:59.758 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-25T09:08:59.758 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=focal 2023-01-25T09:08:59.758 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=focal 2023-01-25T09:08:59.759 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-01-25T09:08:59.774 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2023-01-25T09:08:59.781 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2023-01-25T09:08:59.782 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2023-01-25T09:08:59.830 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2023-01-25T09:08:59.830 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-25T09:08:59.830 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2023-01-25T09:08:59.831 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2023-01-25T09:08:59.831 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-25T09:08:59.831 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="20.04" 2023-01-25T09:08:59.831 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-25T09:08:59.831 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-25T09:08:59.832 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-25T09:08:59.832 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-25T09:08:59.832 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=focal 2023-01-25T09:08:59.833 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=focal 2023-01-25T09:08:59.833 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2023-01-25T09:08:59.847 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T09:08:59.857 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T09:08:59.877 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T09:08:59.878 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2023-01-25T09:08:59.880 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2023-01-25T09:08:59.886 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T09:08:59.902 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T09:08:59.903 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2023-01-25T09:08:59.905 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2023-01-25T09:08:59.945 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T09:09:00.002 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T09:09:00.019 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T09:09:00.020 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T09:09:00.020 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T09:09:00.021 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T09:09:00.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:09:00.027 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2023-01-25T09:09:00.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:09:00.029 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2023-01-25T09:09:00.035 INFO:teuthology.orchestra.run.smithi019.stdout:5.4.0-124-generic 2023-01-25T09:09:00.035 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.4.0-124-generic 2023-01-25T09:09:00.036 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get clean 2023-01-25T09:09:00.037 INFO:teuthology.orchestra.run.smithi106.stdout:5.4.0-124-generic 2023-01-25T09:09:00.037 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.4.0-124-generic 2023-01-25T09:09:00.037 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2023-01-25T09:09:00.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2023-01-25T09:09:00.164 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2023-01-25T09:09:00.319 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-25T09:09:00.447 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:09:00.486 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:09:00.486 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-25T09:09:00.539 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-25T09:09:00.547 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-25T09:09:00.608 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,960 kB] 2023-01-25T09:09:00.712 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [543 kB] 2023-01-25T09:09:00.723 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [320 kB] 2023-01-25T09:09:00.727 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-25T09:09:00.727 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [29.1 kB] 2023-01-25T09:09:00.728 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,463 kB] 2023-01-25T09:09:00.745 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [207 kB] 2023-01-25T09:09:00.745 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [624 B] 2023-01-25T09:09:00.746 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [576 kB] 2023-01-25T09:09:00.746 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [787 kB] 2023-01-25T09:09:00.783 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [152 kB] 2023-01-25T09:09:00.785 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-25T09:09:00.923 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-25T09:09:00.930 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-25T09:09:00.996 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,960 kB] 2023-01-25T09:09:01.082 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [780 kB] 2023-01-25T09:09:01.136 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,359 kB] 2023-01-25T09:09:01.337 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,359 kB] 2023-01-25T09:09:01.510 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [543 kB] 2023-01-25T09:09:01.517 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [404 kB] 2023-01-25T09:09:01.526 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [320 kB] 2023-01-25T09:09:01.532 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.2 kB] 2023-01-25T09:09:01.532 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,560 kB] 2023-01-25T09:09:01.539 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-25T09:09:01.540 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [29.1 kB] 2023-01-25T09:09:01.540 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,463 kB] 2023-01-25T09:09:01.579 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [30.4 kB] 2023-01-25T09:09:01.579 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [220 kB] 2023-01-25T09:09:01.585 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [620 B] 2023-01-25T09:09:01.585 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-25T09:09:01.606 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,019 kB] 2023-01-25T09:09:01.610 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [207 kB] 2023-01-25T09:09:01.616 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [624 B] 2023-01-25T09:09:01.616 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [787 kB] 2023-01-25T09:09:01.629 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [780 kB] 2023-01-25T09:09:01.641 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [576 kB] 2023-01-25T09:09:01.648 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [236 kB] 2023-01-25T09:09:01.648 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [404 kB] 2023-01-25T09:09:01.652 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [23.4 kB] 2023-01-25T09:09:01.659 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [152 kB] 2023-01-25T09:09:01.659 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.2 kB] 2023-01-25T09:09:01.660 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [30.4 kB] 2023-01-25T09:09:01.660 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,560 kB] 2023-01-25T09:09:01.663 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-25T09:09:01.677 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-01-25T09:09:01.677 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-01-25T09:09:01.678 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [604 B] 2023-01-25T09:09:01.678 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-01-25T09:09:01.679 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-01-25T09:09:01.700 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-01-25T09:09:01.728 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [220 kB] 2023-01-25T09:09:01.733 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [620 B] 2023-01-25T09:09:01.734 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,019 kB] 2023-01-25T09:09:01.760 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-25T09:09:01.778 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [236 kB] 2023-01-25T09:09:01.783 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [23.4 kB] 2023-01-25T09:09:01.825 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-01-25T09:09:01.825 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-01-25T09:09:01.826 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [604 B] 2023-01-25T09:09:01.826 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-01-25T09:09:01.826 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-01-25T09:09:01.832 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-01-25T09:09:04.140 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 13.8 MB in 2s (6,689 kB/s) 2023-01-25T09:09:04.897 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 13.8 MB in 3s (5,172 kB/s) 2023-01-25T09:09:05.460 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-01-25T09:09:05.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T09:09:05.566 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-01-25T09:09:05.758 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2023-01-25T09:09:05.759 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2023-01-25T09:09:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2023-01-25T09:09:05.933 INFO:teuthology.orchestra.run.smithi019.stdout: linux-generic linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T09:09:05.934 INFO:teuthology.orchestra.run.smithi019.stdout: linux-headers-generic linux-image-5.4.0-137-generic 2023-01-25T09:09:05.934 INFO:teuthology.orchestra.run.smithi019.stdout: linux-modules-5.4.0-137-generic linux-modules-extra-5.4.0-137-generic 2023-01-25T09:09:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2023-01-25T09:09:05.935 INFO:teuthology.orchestra.run.smithi019.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-01-25T09:09:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2023-01-25T09:09:05.935 INFO:teuthology.orchestra.run.smithi019.stdout: thermald 2023-01-25T09:09:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2023-01-25T09:09:06.005 INFO:teuthology.orchestra.run.smithi019.stdout: linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T09:09:06.005 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-137-generic linux-modules-5.4.0-137-generic 2023-01-25T09:09:06.005 INFO:teuthology.orchestra.run.smithi019.stdout: linux-modules-extra-5.4.0-137-generic 2023-01-25T09:09:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages will be upgraded: 2023-01-25T09:09:06.006 INFO:teuthology.orchestra.run.smithi019.stdout: linux-generic linux-headers-generic linux-image-generic 2023-01-25T09:09:06.207 INFO:teuthology.orchestra.run.smithi019.stdout:3 upgraded, 5 newly installed, 0 to remove and 129 not upgraded. 2023-01-25T09:09:06.208 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 77.1 MB of archives. 2023-01-25T09:09:06.208 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 380 MB of additional disk space will be used. 2023-01-25T09:09:06.208 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-137-generic amd64 5.4.0-137.154 [15.0 MB] 2023-01-25T09:09:06.226 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-01-25T09:09:06.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T09:09:06.317 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-01-25T09:09:06.502 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2023-01-25T09:09:06.502 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2023-01-25T09:09:06.658 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2023-01-25T09:09:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T09:09:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-generic linux-image-5.4.0-137-generic 2023-01-25T09:09:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-5.4.0-137-generic linux-modules-extra-5.4.0-137-generic 2023-01-25T09:09:06.660 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2023-01-25T09:09:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-01-25T09:09:06.660 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2023-01-25T09:09:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: thermald 2023-01-25T09:09:06.711 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2023-01-25T09:09:06.711 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T09:09:06.711 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-137-generic linux-modules-5.4.0-137-generic 2023-01-25T09:09:06.712 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-extra-5.4.0-137-generic 2023-01-25T09:09:06.712 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2023-01-25T09:09:06.713 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-generic linux-image-generic 2023-01-25T09:09:06.764 INFO:teuthology.orchestra.run.smithi106.stdout:3 upgraded, 5 newly installed, 0 to remove and 129 not upgraded. 2023-01-25T09:09:06.765 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 77.1 MB of archives. 2023-01-25T09:09:06.765 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 380 MB of additional disk space will be used. 2023-01-25T09:09:06.765 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-137-generic amd64 5.4.0-137.154 [15.0 MB] 2023-01-25T09:09:07.071 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-137-generic amd64 5.4.0-137.154 [10.5 MB] 2023-01-25T09:09:07.163 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-137-generic amd64 5.4.0-137.154 [39.2 MB] 2023-01-25T09:09:07.442 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-137-generic amd64 5.4.0-137.154 [10.5 MB] 2023-01-25T09:09:07.620 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.137.135 [1,896 B] 2023-01-25T09:09:07.621 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.137.135 [2,528 B] 2023-01-25T09:09:07.621 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137 all 5.4.0-137.154 [11.0 MB] 2023-01-25T09:09:07.714 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137-generic amd64 5.4.0-137.154 [1,400 kB] 2023-01-25T09:09:07.741 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-137-generic amd64 5.4.0-137.154 [39.2 MB] 2023-01-25T09:09:07.777 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.137.135 [2,392 B] 2023-01-25T09:09:08.481 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 77.1 MB in 1s (72.8 MB/s) 2023-01-25T09:09:08.683 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-5.4.0-137-generic. 2023-01-25T09:09:09.174 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.137.135 [1,896 B] 2023-01-25T09:09:09.175 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.137.135 [2,528 B] 2023-01-25T09:09:09.175 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137 all 5.4.0-137.154 [11.0 MB] 2023-01-25T09:09:09.537 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137-generic amd64 5.4.0-137.154 [1,400 kB] 2023-01-25T09:09:09.581 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.137.135 [2,392 B] 2023-01-25T09:09:10.293 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 77.1 MB in 4s (21.6 MB/s) 2023-01-25T09:09:10.450 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-01-25T09:09:10.455 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../0-linux-modules-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:09:10.513 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-modules-5.4.0-137-generic. 2023-01-25T09:09:10.580 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:12.346 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-01-25T09:09:12.351 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../0-linux-modules-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:09:12.460 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:12.506 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-5.4.0-137-generic. 2023-01-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../1-linux-image-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:09:12.620 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:13.725 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-137-generic. 2023-01-25T09:09:13.738 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:09:13.775 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:14.411 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-image-5.4.0-137-generic. 2023-01-25T09:09:14.424 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../1-linux-image-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:09:14.536 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:15.664 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-137-generic. 2023-01-25T09:09:15.679 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:09:15.722 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:18.678 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../3-linux-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:09:18.807 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:09:19.174 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:09:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:09:19.655 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.4.0-137. 2023-01-25T09:09:19.671 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../5-linux-headers-5.4.0-137_5.4.0-137.154_all.deb ... 2023-01-25T09:09:19.713 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T09:09:20.652 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../3-linux-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:09:20.777 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:09:21.136 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:09:21.263 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:09:21.609 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-headers-5.4.0-137. 2023-01-25T09:09:21.624 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../5-linux-headers-5.4.0-137_5.4.0-137.154_all.deb ... 2023-01-25T09:09:21.666 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T09:09:25.262 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.4.0-137-generic. 2023-01-25T09:09:25.285 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../6-linux-headers-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:09:25.347 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:27.227 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-headers-5.4.0-137-generic. 2023-01-25T09:09:27.249 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../6-linux-headers-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:09:27.319 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:28.145 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:09:28.288 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:09:28.650 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T09:09:29.536 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:30.268 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:09:30.420 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:09:30.737 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T09:09:30.754 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:30.858 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:30.880 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:32.058 INFO:teuthology.orchestra.run.smithi106.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:09:32.059 INFO:teuthology.orchestra.run.smithi106.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-137-generic 2023-01-25T09:09:32.119 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:32.191 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:32.245 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:33.400 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-generic (5.4.0.137.135) ... 2023-01-25T09:09:33.476 INFO:teuthology.orchestra.run.smithi019.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:09:33.476 INFO:teuthology.orchestra.run.smithi019.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-137-generic 2023-01-25T09:09:33.551 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-generic (5.4.0.137.135) ... 2023-01-25T09:09:33.606 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:33.677 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-generic (5.4.0.137.135) ... 2023-01-25T09:09:33.804 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:33.895 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-01-25T09:09:33.895 INFO:teuthology.orchestra.run.smithi106.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:09:34.832 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-generic (5.4.0.137.135) ... 2023-01-25T09:09:34.959 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-generic (5.4.0.137.135) ... 2023-01-25T09:09:35.084 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-generic (5.4.0.137.135) ... 2023-01-25T09:09:35.244 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:09:35.314 INFO:teuthology.orchestra.run.smithi019.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-01-25T09:09:35.315 INFO:teuthology.orchestra.run.smithi019.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:09:56.029 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-01-25T09:09:56.029 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub' 2023-01-25T09:09:56.040 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T09:09:56.049 INFO:teuthology.orchestra.run.smithi106.stdout:Generating grub configuration file ... 2023-01-25T09:09:56.385 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:09:56.408 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:09:56.781 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T09:09:57.815 INFO:teuthology.orchestra.run.smithi019.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-01-25T09:09:57.816 INFO:teuthology.orchestra.run.smithi019.stdout:Sourcing file `/etc/default/grub' 2023-01-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi019.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T09:09:57.859 INFO:teuthology.orchestra.run.smithi019.stdout:Generating grub configuration file ... 2023-01-25T09:09:58.182 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:09:58.204 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:09:58.557 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T09:09:58.569 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T09:09:59.616 INFO:teuthology.orchestra.run.smithi106.stdout:done 2023-01-25T09:10:00.067 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2023-01-25T09:10:00.109 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2023-01-25T09:10:00.110 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2023-01-25T09:10:00.110 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2023-01-25T09:10:00.110 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2023-01-25T09:10:00.110 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 19 2023-01-25T09:10:00.111 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T09:10:00.111 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2023-01-25T09:10:00.111 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2023-01-25T09:10:00.111 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.4.0.137.135 2023-01-25T09:10:00.111 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T09:10:00.112 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T09:10:00.112 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2023-01-25T09:10:00.112 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2023-01-25T09:10:00.112 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2023-01-25T09:10:00.113 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2023-01-25T09:10:00.113 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-137-generic 2023-01-25T09:10:00.113 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T09:10:00.114 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T09:10:00.114 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-01-25T09:10:00.114 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T09:10:00.114 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2023-01-25T09:10:00.197 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2023-01-25T09:10:00.358 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T09:10:00.494 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:10:00.585 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T09:10:00.676 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T09:10:01.270 INFO:teuthology.orchestra.run.smithi019.stdout:done 2023-01-25T09:10:01.702 DEBUG:teuthology.orchestra.run.smithi019:> dpkg -s linux-image-generic 2023-01-25T09:10:01.762 INFO:teuthology.orchestra.run.smithi019.stdout:Package: linux-image-generic 2023-01-25T09:10:01.762 INFO:teuthology.orchestra.run.smithi019.stdout:Status: install ok installed 2023-01-25T09:10:01.763 INFO:teuthology.orchestra.run.smithi019.stdout:Priority: optional 2023-01-25T09:10:01.763 INFO:teuthology.orchestra.run.smithi019.stdout:Section: kernel 2023-01-25T09:10:01.763 INFO:teuthology.orchestra.run.smithi019.stdout:Installed-Size: 19 2023-01-25T09:10:01.764 INFO:teuthology.orchestra.run.smithi019.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T09:10:01.764 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: amd64 2023-01-25T09:10:01.764 INFO:teuthology.orchestra.run.smithi019.stdout:Source: linux-meta 2023-01-25T09:10:01.764 INFO:teuthology.orchestra.run.smithi019.stdout:Version: 5.4.0.137.135 2023-01-25T09:10:01.764 INFO:teuthology.orchestra.run.smithi019.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T09:10:01.765 INFO:teuthology.orchestra.run.smithi019.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T09:10:01.765 INFO:teuthology.orchestra.run.smithi019.stdout:Recommends: thermald 2023-01-25T09:10:01.765 INFO:teuthology.orchestra.run.smithi019.stdout:Description: Generic Linux kernel image 2023-01-25T09:10:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: This package will always depend on the latest generic kernel image 2023-01-25T09:10:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: available. 2023-01-25T09:10:01.766 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-137-generic 2023-01-25T09:10:01.767 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T09:10:01.767 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T09:10:01.767 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-01-25T09:10:01.768 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T09:10:01.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get clean 2023-01-25T09:10:01.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2023-01-25T09:10:01.984 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-01-25T09:10:01.984 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T09:10:02.009 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T09:10:02.077 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-01-25T09:10:02.124 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:10:02.214 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T09:10:02.241 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2023-01-25T09:10:02.242 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2023-01-25T09:10:02.306 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T09:10:02.428 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic is already the newest version (5.4.0.137.135). 2023-01-25T09:10:02.428 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 0 newly installed, 0 to remove and 129 not upgraded. 2023-01-25T09:10:02.430 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2023-01-25T09:10:02.450 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2023-01-25T09:10:02.450 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2023-01-25T09:10:02.450 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2023-01-25T09:10:02.450 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2023-01-25T09:10:02.451 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 19 2023-01-25T09:10:02.451 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T09:10:02.451 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2023-01-25T09:10:02.451 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2023-01-25T09:10:02.452 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.4.0.137.135 2023-01-25T09:10:02.452 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T09:10:02.452 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T09:10:02.453 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2023-01-25T09:10:02.453 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2023-01-25T09:10:02.453 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2023-01-25T09:10:02.453 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2023-01-25T09:10:02.454 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-01-25T09:10:02.458 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.M298d3tc2k 2023-01-25T09:10:02.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub/grub.cfg /tmp/tmp.M298d3tc2k 2023-01-25T09:10:02.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.M298d3tc2k 2023-01-25T09:10:02.555 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.M298d3tc2k is 9KB 2023-01-25T09:10:02.570 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.M298d3tc2k 2023-01-25T09:10:02.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-01-25T09:10:02.635 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:10:02.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-01-25T09:10:02.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-01-25T09:10:02.669 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-137-generic 2023-01-25T09:10:02.670 DEBUG:teuthology.orchestra.run.smithi106:> sudo update-grub 2023-01-25T09:10:03.672 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-01-25T09:10:03.697 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T09:10:03.767 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-01-25T09:10:03.939 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2023-01-25T09:10:03.940 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2023-01-25T09:10:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2023-01-25T09:10:04.014 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T09:10:04.024 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2023-01-25T09:10:04.140 INFO:teuthology.orchestra.run.smithi019.stdout:linux-image-generic is already the newest version (5.4.0.137.135). 2023-01-25T09:10:04.141 INFO:teuthology.orchestra.run.smithi019.stdout:0 upgraded, 0 newly installed, 0 to remove and 129 not upgraded. 2023-01-25T09:10:04.142 DEBUG:teuthology.orchestra.run.smithi019:> dpkg -s linux-image-generic 2023-01-25T09:10:04.163 INFO:teuthology.orchestra.run.smithi019.stdout:Package: linux-image-generic 2023-01-25T09:10:04.163 INFO:teuthology.orchestra.run.smithi019.stdout:Status: install ok installed 2023-01-25T09:10:04.164 INFO:teuthology.orchestra.run.smithi019.stdout:Priority: optional 2023-01-25T09:10:04.164 INFO:teuthology.orchestra.run.smithi019.stdout:Section: kernel 2023-01-25T09:10:04.164 INFO:teuthology.orchestra.run.smithi019.stdout:Installed-Size: 19 2023-01-25T09:10:04.164 INFO:teuthology.orchestra.run.smithi019.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T09:10:04.164 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: amd64 2023-01-25T09:10:04.165 INFO:teuthology.orchestra.run.smithi019.stdout:Source: linux-meta 2023-01-25T09:10:04.165 INFO:teuthology.orchestra.run.smithi019.stdout:Version: 5.4.0.137.135 2023-01-25T09:10:04.165 INFO:teuthology.orchestra.run.smithi019.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T09:10:04.165 INFO:teuthology.orchestra.run.smithi019.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T09:10:04.166 INFO:teuthology.orchestra.run.smithi019.stdout:Recommends: thermald 2023-01-25T09:10:04.166 INFO:teuthology.orchestra.run.smithi019.stdout:Description: Generic Linux kernel image 2023-01-25T09:10:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: This package will always depend on the latest generic kernel image 2023-01-25T09:10:04.166 INFO:teuthology.orchestra.run.smithi019.stdout: available. 2023-01-25T09:10:04.167 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2023-01-25T09:10:04.213 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.rUnx9qXPcV 2023-01-25T09:10:04.213 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub/grub.cfg /tmp/tmp.rUnx9qXPcV 2023-01-25T09:10:04.229 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.rUnx9qXPcV 2023-01-25T09:10:04.282 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.rUnx9qXPcV is 9KB 2023-01-25T09:10:04.295 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.rUnx9qXPcV 2023-01-25T09:10:04.297 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:10:04.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-01-25T09:10:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:10:04.362 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:10:04.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-01-25T09:10:04.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-01-25T09:10:04.391 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-137-generic 2023-01-25T09:10:04.391 DEBUG:teuthology.orchestra.run.smithi019:> sudo update-grub 2023-01-25T09:10:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T09:10:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T09:10:05.693 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub' 2023-01-25T09:10:05.699 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T09:10:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2023-01-25T09:10:05.976 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:10:05.988 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:10:06.333 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T09:10:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T09:10:06.397 INFO:teuthology.orchestra.run.smithi106.stderr:done 2023-01-25T09:10:06.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2023-01-25T09:10:08.055 INFO:teuthology.orchestra.run.smithi019.stderr:done 2023-01-25T09:10:08.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2023-01-25T09:10:36.428 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-01-25T09:10:36.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-01-25T09:10:36.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:10:38.060 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-01-25T09:10:38.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-01-25T09:10:38.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:11:36.488 DEBUG:teuthology.orchestra.remote:timed out 2023-01-25T09:11:38.064 DEBUG:teuthology.orchestra.remote:timed out 2023-01-25T09:12:06.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-01-25T09:12:06.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:12:06.726 DEBUG:teuthology.orchestra.run.smithi106:> true 2023-01-25T09:12:07.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-01-25T09:12:07.395 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-137-generic"... 2023-01-25T09:12:07.396 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2023-01-25T09:12:07.402 INFO:teuthology.orchestra.run.smithi106.stdout:5.4.0-137-generic 2023-01-25T09:12:07.403 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-137-generic vs 5.4.0-137-generic 2023-01-25T09:12:07.403 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T09:12:07.403 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-01-25T09:12:08.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-01-25T09:12:08.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:12:08.278 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-01-25T09:12:08.404 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-25T09:12:08.404 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T09:12:08.505 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2023-01-25T09:12:08.532 DEBUG:teuthology.parallel:result is None 2023-01-25T09:12:08.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-01-25T09:12:08.894 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-137-generic"... 2023-01-25T09:12:08.895 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2023-01-25T09:12:08.901 INFO:teuthology.orchestra.run.smithi019.stdout:5.4.0-137-generic 2023-01-25T09:12:08.901 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-137-generic vs 5.4.0-137-generic 2023-01-25T09:12:08.902 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T09:12:08.902 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-01-25T09:12:09.903 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T09:12:09.904 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T09:12:09.998 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2023-01-25T09:12:10.023 DEBUG:teuthology.parallel:result is None 2023-01-25T09:12:10.023 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T09:12:10.031 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T09:12:10.031 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T09:12:10.034 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T09:12:10.041 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T09:12:10.077 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T09:12:10.131 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T09:12:10.132 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T09:12:10.135 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T09:12:10.159 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T09:12:10.178 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T09:12:10.178 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T09:12:10.198 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T09:12:10.214 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:12:10.216 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:12:10.225 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:12:10.225 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:12:10.227 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T09:12:10.234 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T09:12:10.234 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T09:12:10.237 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T09:12:10.251 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T09:12:10.280 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T09:12:10.280 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T09:12:10.285 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T09:12:10.300 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T09:12:10.339 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T09:12:10.344 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:12:10.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T09:12:10.368 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T09:12:10.375 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T09:12:10.424 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:12:10.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T09:12:10.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2023-01-25T09:12:10.448 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2023-01-25T09:12:10.502 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T09:12:10.511 INFO:teuthology.task.internal:Starting timer... 2023-01-25T09:12:10.511 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T09:12:10.547 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T09:12:10.596 DEBUG:teuthology.task.selinux:Excluding smithi019: OS 'ubuntu' does not support SELinux 2023-01-25T09:12:10.596 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2023-01-25T09:12:10.597 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T09:12:10.597 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-01-25T09:12:10.597 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T09:12:10.598 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T09:12:10.647 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-01-25T09:12:10.652 INFO:teuthology.repo_utils:Fetching main from origin 2023-01-25T09:12:10.763 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T09:12:10.780 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T09:12:10.781 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T09:16:54.382 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2023-01-25T09:16:54.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-01-25T09:16:54.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:16:54.432 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-01-25T09:16:54.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-01-25T09:16:54.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:16:54.606 DEBUG:teuthology.orchestra.run.smithi106:> true 2023-01-25T09:16:54.725 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T09:16:54.735 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T09:16:54.736 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T09:16:54.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T09:16:54.739 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T09:16:54.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T09:16:54.772 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-01-25T09:16:54.773 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: Command line: ntpd -gq 2023-01-25T09:16:54.774 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: proto: precision = 0.090 usec (-23) 2023-01-25T09:16:54.774 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-01-25T09:16:54.774 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: Command line: ntpd -gq 2023-01-25T09:16:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T09:16:54.775 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T09:16:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:restrict ::: KOD does nothing without LIMITED. 2023-01-25T09:16:54.777 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: restrict ::: KOD does nothing without LIMITED. 2023-01-25T09:16:54.777 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: Listen and drop on 0 v6wildcard [::]:123 2023-01-25T09:16:54.777 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-01-25T09:16:54.777 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: Listen normally on 2 lo 127.0.0.1:123 2023-01-25T09:16:54.778 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: Listen normally on 3 ens1f0 172.21.15.19:123 2023-01-25T09:16:54.778 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: Listen normally on 4 lo [::1]:123 2023-01-25T09:16:54.778 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:161e%3]:123 2023-01-25T09:16:54.778 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:16:54 ntpd[19353]: Listening on routing socket on fd #22 for interface updates 2023-01-25T09:16:54.779 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: proto: precision = 0.100 usec (-23) 2023-01-25T09:16:54.779 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T09:16:54.780 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T09:16:54.780 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2023-01-25T09:16:54.781 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: restrict ::: KOD does nothing without LIMITED. 2023-01-25T09:16:54.781 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: Listen and drop on 0 v6wildcard [::]:123 2023-01-25T09:16:54.782 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-01-25T09:16:54.782 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: Listen normally on 2 lo 127.0.0.1:123 2023-01-25T09:16:54.782 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2023-01-25T09:16:54.782 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: Listen normally on 4 lo [::1]:123 2023-01-25T09:16:54.782 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2023-01-25T09:16:54.782 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:16:54 ntpd[19449]: Listening on routing socket on fd #22 for interface updates 2023-01-25T09:16:55.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:55 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:55.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:55 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:55.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:55 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:55.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:55 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:55.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:55 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:55.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:55 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:55.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:55 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:55.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:55 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:55.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:55 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:55.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:55 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:55.777 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:55 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:55.777 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:55 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:56.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:56 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:56.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:56 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:56.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:56 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:56.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:56 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:56.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:56 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:56.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:56 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:57.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:57.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:57.777 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:57.777 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:57 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:57.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:57.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:57.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:57.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:57.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:57.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:57.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:57.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:57.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:57.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:57.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:57.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:57 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:58 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:58 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:58 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:58 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:58.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:58 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:58.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:58 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:58.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:58 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:58.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:58 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:58.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:58 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:58.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:58 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:58.777 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:58 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:58.777 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:58 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:59.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:59.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.777 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.777 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:59.777 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:16:59 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:16:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:16:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:16:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:16:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:16:59 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:17:00.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:00 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:00.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:00 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:00.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:00 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:00.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:00 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:00.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:00 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:17:00.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:00 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:17:00.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:00 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:00.776 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:00 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:00.777 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:00 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:00.777 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:00 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:00.777 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:00 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:17:00.777 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:00 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:17:01.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:01.774 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:01.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:01.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:01.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:01.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:01.775 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:17:01.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:17:01.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:01.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:01.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:17:01.776 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:17:01.777 INFO:teuthology.orchestra.run.smithi019.stdout:25 Jan 09:17:01 ntpd[19353]: ntpd: time slew +0.000548 s 2023-01-25T09:17:01.777 INFO:teuthology.orchestra.run.smithi019.stdout:ntpd: time slew +0.000548s 2023-01-25T09:17:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-01-25T09:17:01.778 INFO:teuthology.orchestra.run.smithi019.stderr:25 Jan 09:17:01 ntpd[19353]: can't open /var/log/ntpstats/loopstats.20230125: Permission denied 2023-01-25T09:17:01.779 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:17:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:17:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:17:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:17:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:17:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:17:01.782 INFO:teuthology.orchestra.run.smithi106.stdout:25 Jan 09:17:01 ntpd[19449]: ntpd: time slew -0.000188 s 2023-01-25T09:17:01.782 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time slew -0.000188s 2023-01-25T09:17:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-01-25T09:17:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:25 Jan 09:17:01 ntpd[19449]: can't open /var/log/ntpstats/loopstats.20230125: Permission denied 2023-01-25T09:17:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2023-01-25T09:17:01.839 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2023-01-25T09:17:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:17:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:17:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:17:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:17:01.846 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2023-01-25T09:17:01.846 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2023-01-25T09:17:01.846 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:17:01.846 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:17:01.847 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:17:01.847 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:17:01.848 INFO:teuthology.run_tasks:Running task install... 2023-01-25T09:17:01.857 DEBUG:teuthology.task.install:project ceph 2023-01-25T09:17:01.858 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}} 2023-01-25T09:17:01.858 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'} 2023-01-25T09:17:01.858 INFO:teuthology.task.install:Using flavor: default 2023-01-25T09:17:01.865 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T09:17:01.865 INFO:teuthology.task.install:extra packages: [] 2023-01-25T09:17:01.866 DEBUG:teuthology.orchestra.run.smithi019:> sudo lsb_release -is 2023-01-25T09:17:01.934 INFO:teuthology.orchestra.run.smithi019.stdout:Ubuntu 2023-01-25T09:17:01.939 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:17:01.940 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2023-01-25T09:17:01.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-key list | grep Ceph 2023-01-25T09:17:01.990 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2023-01-25T09:17:01.995 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:17:01.996 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2023-01-25T09:17:02.040 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-01-25T09:17:02.094 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-01-25T09:17:02.104 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-01-25T09:17:02.105 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph.com (release key) 2023-01-25T09:17:02.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo lsb_release -is 2023-01-25T09:17:02.153 INFO:teuthology.orchestra.run.smithi019.stdout:Ubuntu 2023-01-25T09:17:02.155 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-01-25T09:17:02.155 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2023-01-25T09:17:02.157 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2023-01-25T09:17:02.159 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:17:02.159 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-01-25T09:17:02.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:17:02.204 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2023-01-25T09:17:02.209 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:17:02.210 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-01-25T09:17:02.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:17:02.434 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default/ 2023-01-25T09:17:02.435 INFO:teuthology.task.install.deb:Package version is 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:17:02.470 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default/ 2023-01-25T09:17:02.470 INFO:teuthology.task.install.deb:Package version is 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:17:02.590 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:17:02.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-01-25T09:17:02.600 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:17:02.601 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-01-25T09:17:02.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2023-01-25T09:17:02.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2023-01-25T09:17:02.845 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal InRelease 2023-01-25T09:17:02.850 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal InRelease 2023-01-25T09:17:02.880 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-01-25T09:17:02.886 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-01-25T09:17:02.916 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release.gpg 2023-01-25T09:17:02.917 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T09:17:02.922 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release.gpg 2023-01-25T09:17:02.950 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-01-25T09:17:02.956 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2023-01-25T09:17:03.004 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2023-01-25T09:17:03.013 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-01-25T09:17:03.115 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:17:03.143 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:17:03.143 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T09:17:03.206 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T09:17:03.222 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T09:17:03.298 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T09:17:03.313 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T09:17:03.639 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 28.4 kB in 1s (33.0 kB/s) 2023-01-25T09:17:03.808 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 28.4 kB in 1s (27.5 kB/s) 2023-01-25T09:17:04.574 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-01-25T09:17:04.598 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-1986-g44e4095d-1focal cephadm=18.0.0-1986-g44e4095d-1focal ceph-mds=18.0.0-1986-g44e4095d-1focal ceph-mgr=18.0.0-1986-g44e4095d-1focal ceph-common=18.0.0-1986-g44e4095d-1focal ceph-fuse=18.0.0-1986-g44e4095d-1focal ceph-test=18.0.0-1986-g44e4095d-1focal ceph-volume=18.0.0-1986-g44e4095d-1focal radosgw=18.0.0-1986-g44e4095d-1focal python3-rados=18.0.0-1986-g44e4095d-1focal python3-rgw=18.0.0-1986-g44e4095d-1focal python3-cephfs=18.0.0-1986-g44e4095d-1focal python3-rbd=18.0.0-1986-g44e4095d-1focal libcephfs2=18.0.0-1986-g44e4095d-1focal libcephfs-dev=18.0.0-1986-g44e4095d-1focal librados2=18.0.0-1986-g44e4095d-1focal librbd1=18.0.0-1986-g44e4095d-1focal rbd-fuse=18.0.0-1986-g44e4095d-1focal 2023-01-25T09:17:04.663 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2023-01-25T09:17:04.787 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-01-25T09:17:04.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-1986-g44e4095d-1focal cephadm=18.0.0-1986-g44e4095d-1focal ceph-mds=18.0.0-1986-g44e4095d-1focal ceph-mgr=18.0.0-1986-g44e4095d-1focal ceph-common=18.0.0-1986-g44e4095d-1focal ceph-fuse=18.0.0-1986-g44e4095d-1focal ceph-test=18.0.0-1986-g44e4095d-1focal ceph-volume=18.0.0-1986-g44e4095d-1focal radosgw=18.0.0-1986-g44e4095d-1focal python3-rados=18.0.0-1986-g44e4095d-1focal python3-rgw=18.0.0-1986-g44e4095d-1focal python3-cephfs=18.0.0-1986-g44e4095d-1focal python3-rbd=18.0.0-1986-g44e4095d-1focal libcephfs2=18.0.0-1986-g44e4095d-1focal libcephfs-dev=18.0.0-1986-g44e4095d-1focal librados2=18.0.0-1986-g44e4095d-1focal librbd1=18.0.0-1986-g44e4095d-1focal rbd-fuse=18.0.0-1986-g44e4095d-1focal 2023-01-25T09:17:04.827 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2023-01-25T09:17:04.828 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2023-01-25T09:17:04.878 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2023-01-25T09:17:04.981 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2023-01-25T09:17:04.982 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-01-25T09:17:04.982 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2023-01-25T09:17:04.982 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2023-01-25T09:17:04.982 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-01-25T09:17:04.983 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-01-25T09:17:04.983 INFO:teuthology.orchestra.run.smithi106.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-01-25T09:17:04.983 INFO:teuthology.orchestra.run.smithi106.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-01-25T09:17:04.983 INFO:teuthology.orchestra.run.smithi106.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-01-25T09:17:04.985 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-01-25T09:17:04.985 INFO:teuthology.orchestra.run.smithi106.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-01-25T09:17:04.986 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-01-25T09:17:04.986 INFO:teuthology.orchestra.run.smithi106.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-01-25T09:17:04.986 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-01-25T09:17:04.986 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-01-25T09:17:04.987 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T09:17:04.987 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T09:17:04.987 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T09:17:04.987 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T09:17:04.988 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T09:17:04.988 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-01-25T09:17:04.988 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-01-25T09:17:04.988 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-01-25T09:17:04.988 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-01-25T09:17:04.989 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-01-25T09:17:04.989 INFO:teuthology.orchestra.run.smithi106.stdout: qttranslations5-l10n socat xmlstarlet 2023-01-25T09:17:04.989 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2023-01-25T09:17:04.989 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-01-25T09:17:04.989 INFO:teuthology.orchestra.run.smithi106.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-01-25T09:17:04.990 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-01-25T09:17:04.990 INFO:teuthology.orchestra.run.smithi106.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-01-25T09:17:04.990 INFO:teuthology.orchestra.run.smithi106.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-01-25T09:17:04.990 INFO:teuthology.orchestra.run.smithi106.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-01-25T09:17:04.990 INFO:teuthology.orchestra.run.smithi106.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-01-25T09:17:04.990 INFO:teuthology.orchestra.run.smithi106.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-01-25T09:17:04.991 INFO:teuthology.orchestra.run.smithi106.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-01-25T09:17:04.991 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2023-01-25T09:17:04.991 INFO:teuthology.orchestra.run.smithi106.stdout: btrfs-tools 2023-01-25T09:17:05.069 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2023-01-25T09:17:05.070 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2023-01-25T09:17:05.094 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2023-01-25T09:17:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-01-25T09:17:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-01-25T09:17:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-01-25T09:17:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-01-25T09:17:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-01-25T09:17:05.096 INFO:teuthology.orchestra.run.smithi106.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-01-25T09:17:05.096 INFO:teuthology.orchestra.run.smithi106.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-01-25T09:17:05.097 INFO:teuthology.orchestra.run.smithi106.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-01-25T09:17:05.097 INFO:teuthology.orchestra.run.smithi106.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-01-25T09:17:05.097 INFO:teuthology.orchestra.run.smithi106.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-01-25T09:17:05.098 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-01-25T09:17:05.098 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-01-25T09:17:05.098 INFO:teuthology.orchestra.run.smithi106.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-01-25T09:17:05.098 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T09:17:05.099 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T09:17:05.099 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T09:17:05.099 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T09:17:05.099 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T09:17:05.099 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-01-25T09:17:05.100 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-01-25T09:17:05.100 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-01-25T09:17:05.100 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-01-25T09:17:05.100 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-01-25T09:17:05.100 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-01-25T09:17:05.101 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet 2023-01-25T09:17:05.101 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2023-01-25T09:17:05.101 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 librbd1 2023-01-25T09:17:05.158 INFO:teuthology.orchestra.run.smithi106.stdout:2 upgraded, 110 newly installed, 0 to remove and 124 not upgraded. 2023-01-25T09:17:05.159 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 199 MB of archives. 2023-01-25T09:17:05.159 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 975 MB of additional disk space will be used. 2023-01-25T09:17:05.159 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-01-25T09:17:05.240 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-01-25T09:17:05.243 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-01-25T09:17:05.245 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2023-01-25T09:17:05.247 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-01-25T09:17:05.247 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2023-01-25T09:17:05.247 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2023-01-25T09:17:05.247 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-01-25T09:17:05.247 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-01-25T09:17:05.248 INFO:teuthology.orchestra.run.smithi019.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-01-25T09:17:05.248 INFO:teuthology.orchestra.run.smithi019.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-01-25T09:17:05.248 INFO:teuthology.orchestra.run.smithi019.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-01-25T09:17:05.249 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-01-25T09:17:05.249 INFO:teuthology.orchestra.run.smithi019.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-01-25T09:17:05.249 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-01-25T09:17:05.250 INFO:teuthology.orchestra.run.smithi019.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-01-25T09:17:05.250 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-01-25T09:17:05.250 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-01-25T09:17:05.250 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T09:17:05.250 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T09:17:05.251 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T09:17:05.251 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T09:17:05.251 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T09:17:05.251 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-01-25T09:17:05.252 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-01-25T09:17:05.252 INFO:teuthology.orchestra.run.smithi019.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-01-25T09:17:05.252 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-01-25T09:17:05.252 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-01-25T09:17:05.252 INFO:teuthology.orchestra.run.smithi019.stdout: qttranslations5-l10n socat xmlstarlet 2023-01-25T09:17:05.253 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2023-01-25T09:17:05.253 INFO:teuthology.orchestra.run.smithi019.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-01-25T09:17:05.253 INFO:teuthology.orchestra.run.smithi019.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-01-25T09:17:05.253 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-01-25T09:17:05.253 INFO:teuthology.orchestra.run.smithi019.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-01-25T09:17:05.254 INFO:teuthology.orchestra.run.smithi019.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-01-25T09:17:05.254 INFO:teuthology.orchestra.run.smithi019.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-01-25T09:17:05.254 INFO:teuthology.orchestra.run.smithi019.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-01-25T09:17:05.254 INFO:teuthology.orchestra.run.smithi019.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-01-25T09:17:05.254 INFO:teuthology.orchestra.run.smithi019.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-01-25T09:17:05.255 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2023-01-25T09:17:05.255 INFO:teuthology.orchestra.run.smithi019.stdout: btrfs-tools 2023-01-25T09:17:05.260 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-01-25T09:17:05.312 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-01-25T09:17:05.314 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-01-25T09:17:05.320 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-01-25T09:17:05.322 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-01-25T09:17:05.322 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-01-25T09:17:05.323 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-01-25T09:17:05.324 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-01-25T09:17:05.327 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-01-25T09:17:05.327 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-01-25T09:17:05.329 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-01-25T09:17:05.345 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-01-25T09:17:05.346 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-01-25T09:17:05.347 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-01-25T09:17:05.348 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-01-25T09:17:05.348 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-01-25T09:17:05.349 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-01-25T09:17:05.350 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-01-25T09:17:05.350 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-01-25T09:17:05.352 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-01-25T09:17:05.358 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2023-01-25T09:17:05.359 INFO:teuthology.orchestra.run.smithi019.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-01-25T09:17:05.359 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-01-25T09:17:05.359 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-01-25T09:17:05.360 INFO:teuthology.orchestra.run.smithi019.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-01-25T09:17:05.361 INFO:teuthology.orchestra.run.smithi019.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-01-25T09:17:05.361 INFO:teuthology.orchestra.run.smithi019.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-01-25T09:17:05.361 INFO:teuthology.orchestra.run.smithi019.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-01-25T09:17:05.361 INFO:teuthology.orchestra.run.smithi019.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-01-25T09:17:05.362 INFO:teuthology.orchestra.run.smithi019.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-01-25T09:17:05.362 INFO:teuthology.orchestra.run.smithi019.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-01-25T09:17:05.362 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-01-25T09:17:05.362 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-01-25T09:17:05.362 INFO:teuthology.orchestra.run.smithi019.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-01-25T09:17:05.363 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T09:17:05.363 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T09:17:05.363 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T09:17:05.363 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T09:17:05.363 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T09:17:05.364 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-01-25T09:17:05.364 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-01-25T09:17:05.364 INFO:teuthology.orchestra.run.smithi019.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-01-25T09:17:05.364 INFO:teuthology.orchestra.run.smithi019.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-01-25T09:17:05.364 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-01-25T09:17:05.365 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-01-25T09:17:05.365 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet 2023-01-25T09:17:05.365 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages will be upgraded: 2023-01-25T09:17:05.366 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-01-25T09:17:05.366 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 librbd1 2023-01-25T09:17:05.371 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-01-25T09:17:05.377 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-01-25T09:17:05.377 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-01-25T09:17:05.378 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-01-25T09:17:05.379 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-01-25T09:17:05.380 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-01-25T09:17:05.382 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-1986-g44e4095d-1focal [3,428 kB] 2023-01-25T09:17:05.383 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-01-25T09:17:05.385 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-01-25T09:17:05.386 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-01-25T09:17:05.398 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-01-25T09:17:05.399 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-01-25T09:17:05.400 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-01-25T09:17:05.416 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-01-25T09:17:05.416 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-01-25T09:17:05.417 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-01-25T09:17:05.418 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-01-25T09:17:05.419 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-01-25T09:17:05.420 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-01-25T09:17:05.421 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-01-25T09:17:05.432 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-01-25T09:17:05.433 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-01-25T09:17:05.434 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-01-25T09:17:05.449 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-01-25T09:17:05.451 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-01-25T09:17:05.451 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-01-25T09:17:05.452 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-01-25T09:17:05.532 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-01-25T09:17:05.547 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-01-25T09:17:05.548 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-01-25T09:17:05.561 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-01-25T09:17:05.561 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-01-25T09:17:05.572 INFO:teuthology.orchestra.run.smithi019.stdout:2 upgraded, 110 newly installed, 0 to remove and 124 not upgraded. 2023-01-25T09:17:05.572 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 199 MB of archives. 2023-01-25T09:17:05.572 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 975 MB of additional disk space will be used. 2023-01-25T09:17:05.573 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-01-25T09:17:05.600 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-1986-g44e4095d-1focal [3,428 kB] 2023-01-25T09:17:05.632 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-01-25T09:17:05.633 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-01-25T09:17:05.634 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-01-25T09:17:05.635 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-01-25T09:17:05.636 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-01-25T09:17:05.638 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-01-25T09:17:05.638 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-01-25T09:17:05.649 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-01-25T09:17:05.653 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-01-25T09:17:05.654 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-01-25T09:17:05.666 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-01-25T09:17:05.667 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-01-25T09:17:05.670 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-01-25T09:17:05.673 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-01-25T09:17:05.691 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-01-25T09:17:05.693 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-01-25T09:17:05.695 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-01-25T09:17:05.736 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-01-25T09:17:05.737 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-01-25T09:17:05.737 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-01-25T09:17:05.737 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-01-25T09:17:05.749 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-01-25T09:17:05.749 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-01-25T09:17:05.751 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-01-25T09:17:05.751 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-01-25T09:17:05.751 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-01-25T09:17:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-01-25T09:17:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-01-25T09:17:06.125 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-01-25T09:17:06.163 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-1986-g44e4095d-1focal [3,962 kB] 2023-01-25T09:17:06.358 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-1986-g44e4095d-1focal [3,962 kB] 2023-01-25T09:17:06.399 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-01-25T09:17:06.409 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-01-25T09:17:06.440 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-01-25T09:17:06.451 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-01-25T09:17:06.451 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-01-25T09:17:06.456 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-01-25T09:17:06.456 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-01-25T09:17:06.471 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-01-25T09:17:06.471 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-01-25T09:17:06.491 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-01-25T09:17:06.558 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-1986-g44e4095d-1focal [720 kB] 2023-01-25T09:17:06.568 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-01-25T09:17:06.569 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-01-25T09:17:06.570 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-01-25T09:17:06.571 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-01-25T09:17:06.572 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-01-25T09:17:06.573 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-01-25T09:17:06.575 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-01-25T09:17:06.576 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-01-25T09:17:06.582 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-01-25T09:17:06.627 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-1986-g44e4095d-1focal [376 kB] 2023-01-25T09:17:06.643 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-1986-g44e4095d-1focal [22.4 kB] 2023-01-25T09:17:06.643 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-1986-g44e4095d-1focal [184 kB] 2023-01-25T09:17:06.669 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-1986-g44e4095d-1focal [46.5 kB] 2023-01-25T09:17:06.670 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-01-25T09:17:06.670 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-01-25T09:17:06.671 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-1986-g44e4095d-1focal [354 kB] 2023-01-25T09:17:06.679 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-01-25T09:17:06.680 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-01-25T09:17:06.681 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-01-25T09:17:06.682 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-01-25T09:17:06.684 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-01-25T09:17:06.685 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-01-25T09:17:06.688 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-01-25T09:17:06.703 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-1986-g44e4095d-1focal [6,521 kB] 2023-01-25T09:17:06.767 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-01-25T09:17:06.770 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-01-25T09:17:06.775 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-1986-g44e4095d-1focal [720 kB] 2023-01-25T09:17:06.847 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-1986-g44e4095d-1focal [376 kB] 2023-01-25T09:17:06.858 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-01-25T09:17:06.858 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-01-25T09:17:06.859 INFO:teuthology.orchestra.run.smithi019.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-01-25T09:17:06.861 INFO:teuthology.orchestra.run.smithi019.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-01-25T09:17:06.862 INFO:teuthology.orchestra.run.smithi019.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-01-25T09:17:06.862 INFO:teuthology.orchestra.run.smithi019.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-1986-g44e4095d-1focal [22.4 kB] 2023-01-25T09:17:06.863 INFO:teuthology.orchestra.run.smithi019.stdout:Get:45 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-1986-g44e4095d-1focal [184 kB] 2023-01-25T09:17:06.864 INFO:teuthology.orchestra.run.smithi019.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-01-25T09:17:06.865 INFO:teuthology.orchestra.run.smithi019.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-01-25T09:17:06.866 INFO:teuthology.orchestra.run.smithi019.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-01-25T09:17:06.891 INFO:teuthology.orchestra.run.smithi019.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-1986-g44e4095d-1focal [46.5 kB] 2023-01-25T09:17:06.893 INFO:teuthology.orchestra.run.smithi019.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-1986-g44e4095d-1focal [354 kB] 2023-01-25T09:17:06.926 INFO:teuthology.orchestra.run.smithi019.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-1986-g44e4095d-1focal [6,521 kB] 2023-01-25T09:17:06.949 INFO:teuthology.orchestra.run.smithi019.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-01-25T09:17:06.952 INFO:teuthology.orchestra.run.smithi019.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-01-25T09:17:07.040 INFO:teuthology.orchestra.run.smithi019.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-01-25T09:17:07.043 INFO:teuthology.orchestra.run.smithi019.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-01-25T09:17:07.045 INFO:teuthology.orchestra.run.smithi019.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-01-25T09:17:07.047 INFO:teuthology.orchestra.run.smithi019.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-01-25T09:17:07.048 INFO:teuthology.orchestra.run.smithi019.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-01-25T09:17:07.049 INFO:teuthology.orchestra.run.smithi019.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-01-25T09:17:07.088 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-1986-g44e4095d-1focal [104 kB] 2023-01-25T09:17:07.090 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-1986-g44e4095d-1focal [467 kB] 2023-01-25T09:17:07.116 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-1986-g44e4095d-1focal [24.9 MB] 2023-01-25T09:17:07.357 INFO:teuthology.orchestra.run.smithi019.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-01-25T09:17:07.447 INFO:teuthology.orchestra.run.smithi019.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-01-25T09:17:07.448 INFO:teuthology.orchestra.run.smithi019.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-1986-g44e4095d-1focal [104 kB] 2023-01-25T09:17:07.449 INFO:teuthology.orchestra.run.smithi019.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-1986-g44e4095d-1focal [467 kB] 2023-01-25T09:17:07.449 INFO:teuthology.orchestra.run.smithi019.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-01-25T09:17:07.456 INFO:teuthology.orchestra.run.smithi019.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-1986-g44e4095d-1focal [24.9 MB] 2023-01-25T09:17:07.502 INFO:teuthology.orchestra.run.smithi019.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-01-25T09:17:07.503 INFO:teuthology.orchestra.run.smithi019.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-01-25T09:17:07.504 INFO:teuthology.orchestra.run.smithi019.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-01-25T09:17:07.505 INFO:teuthology.orchestra.run.smithi019.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-01-25T09:17:07.506 INFO:teuthology.orchestra.run.smithi019.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-01-25T09:17:07.507 INFO:teuthology.orchestra.run.smithi019.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-01-25T09:17:07.507 INFO:teuthology.orchestra.run.smithi019.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-01-25T09:17:07.540 INFO:teuthology.orchestra.run.smithi019.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-01-25T09:17:07.601 INFO:teuthology.orchestra.run.smithi019.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-01-25T09:17:07.601 INFO:teuthology.orchestra.run.smithi019.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-01-25T09:17:07.606 INFO:teuthology.orchestra.run.smithi019.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-01-25T09:17:07.609 INFO:teuthology.orchestra.run.smithi019.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-01-25T09:17:07.612 INFO:teuthology.orchestra.run.smithi019.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-01-25T09:17:07.613 INFO:teuthology.orchestra.run.smithi019.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-01-25T09:17:07.617 INFO:teuthology.orchestra.run.smithi019.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-01-25T09:17:07.619 INFO:teuthology.orchestra.run.smithi019.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-01-25T09:17:07.698 INFO:teuthology.orchestra.run.smithi019.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-01-25T09:17:07.723 INFO:teuthology.orchestra.run.smithi019.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-01-25T09:17:07.727 INFO:teuthology.orchestra.run.smithi019.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-01-25T09:17:07.880 INFO:teuthology.orchestra.run.smithi019.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-01-25T09:17:07.882 INFO:teuthology.orchestra.run.smithi019.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-01-25T09:17:07.882 INFO:teuthology.orchestra.run.smithi019.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-01-25T09:17:07.906 INFO:teuthology.orchestra.run.smithi019.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-01-25T09:17:07.926 INFO:teuthology.orchestra.run.smithi019.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-01-25T09:17:07.927 INFO:teuthology.orchestra.run.smithi019.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-01-25T09:17:07.927 INFO:teuthology.orchestra.run.smithi019.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-01-25T09:17:07.928 INFO:teuthology.orchestra.run.smithi019.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-01-25T09:17:07.928 INFO:teuthology.orchestra.run.smithi019.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-01-25T09:17:08.736 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-1986-g44e4095d-1focal [10.3 MB] 2023-01-25T09:17:09.255 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-1986-g44e4095d-1focal [221 kB] 2023-01-25T09:17:09.278 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-1986-g44e4095d-1focal [133 kB] 2023-01-25T09:17:09.281 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-1986-g44e4095d-1focal [1,534 kB] 2023-01-25T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-1986-g44e4095d-1focal [7,860 kB] 2023-01-25T09:17:09.466 INFO:teuthology.orchestra.run.smithi019.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-1986-g44e4095d-1focal [10.3 MB] 2023-01-25T09:17:09.802 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-1986-g44e4095d-1focal [27.5 MB] 2023-01-25T09:17:10.311 INFO:teuthology.orchestra.run.smithi019.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-1986-g44e4095d-1focal [221 kB] 2023-01-25T09:17:10.324 INFO:teuthology.orchestra.run.smithi019.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-1986-g44e4095d-1focal [133 kB] 2023-01-25T09:17:10.339 INFO:teuthology.orchestra.run.smithi019.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-1986-g44e4095d-1focal [1,534 kB] 2023-01-25T09:17:10.459 INFO:teuthology.orchestra.run.smithi019.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-1986-g44e4095d-1focal [7,860 kB] 2023-01-25T09:17:11.039 INFO:teuthology.orchestra.run.smithi019.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-1986-g44e4095d-1focal [27.5 MB] 2023-01-25T09:17:11.673 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-1986-g44e4095d-1focal [3,808 B] 2023-01-25T09:17:11.673 INFO:teuthology.orchestra.run.smithi106.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-1986-g44e4095d-1focal [829 kB] 2023-01-25T09:17:11.687 INFO:teuthology.orchestra.run.smithi106.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-1986-g44e4095d-1focal [2,279 kB] 2023-01-25T09:17:11.789 INFO:teuthology.orchestra.run.smithi106.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-1986-g44e4095d-1focal [96.2 kB] 2023-01-25T09:17:11.792 INFO:teuthology.orchestra.run.smithi106.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-1986-g44e4095d-1focal [115 kB] 2023-01-25T09:17:11.818 INFO:teuthology.orchestra.run.smithi106.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-1986-g44e4095d-1focal [1,787 kB] 2023-01-25T09:17:11.943 INFO:teuthology.orchestra.run.smithi106.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-1986-g44e4095d-1focal [7,881 kB] 2023-01-25T09:17:12.460 INFO:teuthology.orchestra.run.smithi106.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-1986-g44e4095d-1focal [3,932 B] 2023-01-25T09:17:12.460 INFO:teuthology.orchestra.run.smithi106.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-1986-g44e4095d-1focal [48.3 MB] 2023-01-25T09:17:13.339 INFO:teuthology.orchestra.run.smithi019.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-1986-g44e4095d-1focal [3,808 B] 2023-01-25T09:17:13.340 INFO:teuthology.orchestra.run.smithi019.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-1986-g44e4095d-1focal [829 kB] 2023-01-25T09:17:13.350 INFO:teuthology.orchestra.run.smithi019.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-1986-g44e4095d-1focal [2,279 kB] 2023-01-25T09:17:13.511 INFO:teuthology.orchestra.run.smithi019.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-1986-g44e4095d-1focal [96.2 kB] 2023-01-25T09:17:13.517 INFO:teuthology.orchestra.run.smithi019.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-1986-g44e4095d-1focal [115 kB] 2023-01-25T09:17:13.521 INFO:teuthology.orchestra.run.smithi019.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-1986-g44e4095d-1focal [1,787 kB] 2023-01-25T09:17:13.658 INFO:teuthology.orchestra.run.smithi019.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-1986-g44e4095d-1focal [7,881 kB] 2023-01-25T09:17:14.264 INFO:teuthology.orchestra.run.smithi019.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-1986-g44e4095d-1focal [3,932 B] 2023-01-25T09:17:14.265 INFO:teuthology.orchestra.run.smithi019.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-1986-g44e4095d-1focal [48.3 MB] 2023-01-25T09:17:15.543 INFO:teuthology.orchestra.run.smithi106.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-1986-g44e4095d-1focal [225 kB] 2023-01-25T09:17:15.548 INFO:teuthology.orchestra.run.smithi106.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-1986-g44e4095d-1focal [27.4 kB] 2023-01-25T09:17:15.548 INFO:teuthology.orchestra.run.smithi106.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-1986-g44e4095d-1focal [13.3 MB] 2023-01-25T09:17:16.492 INFO:teuthology.orchestra.run.smithi106.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-1986-g44e4095d-1focal [97.2 kB] 2023-01-25T09:17:17.114 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 199 MB in 11s (17.5 MB/s) 2023-01-25T09:17:17.284 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-01-25T09:17:17.342 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141754 files and directories currently installed.) 2023-01-25T09:17:17.346 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-01-25T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T09:17:17.811 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-01-25T09:17:17.830 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-01-25T09:17:17.869 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T09:17:18.180 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-01-25T09:17:18.197 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-01-25T09:17:18.230 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T09:17:18.684 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-01-25T09:17:18.704 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:17:18.753 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:17:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-01-25T09:17:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:17:19.262 INFO:teuthology.orchestra.run.smithi019.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-1986-g44e4095d-1focal [225 kB] 2023-01-25T09:17:19.266 INFO:teuthology.orchestra.run.smithi019.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-1986-g44e4095d-1focal [27.4 kB] 2023-01-25T09:17:19.267 INFO:teuthology.orchestra.run.smithi019.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-1986-g44e4095d-1focal [13.3 MB] 2023-01-25T09:17:19.287 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:17:19.657 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-01-25T09:17:19.676 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:17:19.723 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:17:20.068 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-01-25T09:17:20.088 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-01-25T09:17:20.126 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T09:17:20.160 INFO:teuthology.orchestra.run.smithi019.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-1986-g44e4095d-1focal [97.2 kB] 2023-01-25T09:17:20.440 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../007-librbd1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:20.555 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T09:17:20.799 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 199 MB in 15s (13.5 MB/s) 2023-01-25T09:17:20.968 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-01-25T09:17:21.026 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141754 files and directories currently installed.) 2023-01-25T09:17:21.030 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-01-25T09:17:21.117 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T09:17:21.234 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../008-librados2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:21.367 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T09:17:21.545 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-01-25T09:17:21.565 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-01-25T09:17:21.595 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T09:17:21.957 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-01-25T09:17:21.975 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-01-25T09:17:22.040 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T09:17:22.063 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2023-01-25T09:17:22.079 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:22.121 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:22.449 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2023-01-25T09:17:22.465 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../010-python3-rados_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:22.507 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:22.527 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-01-25T09:17:22.546 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:17:22.637 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:17:22.843 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-01-25T09:17:22.860 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:22.901 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:23.130 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-01-25T09:17:23.146 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:17:23.213 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:17:23.312 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2023-01-25T09:17:23.333 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:23.396 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:23.592 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-01-25T09:17:23.610 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:17:23.650 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:17:23.733 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2023-01-25T09:17:23.747 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:23.790 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:24.037 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-01-25T09:17:24.055 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-01-25T09:17:24.086 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T09:17:24.101 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2023-01-25T09:17:24.118 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-01-25T09:17:24.151 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-01-25T09:17:24.387 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2023-01-25T09:17:24.403 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:24.446 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:24.464 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../007-librbd1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:24.590 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librbd1 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T09:17:24.821 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-01-25T09:17:24.837 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-01-25T09:17:24.879 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T09:17:25.266 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-01-25T09:17:25.282 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-01-25T09:17:25.285 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../008-librados2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:25.326 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T09:17:25.411 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librados2 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T09:17:25.587 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-01-25T09:17:25.606 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-01-25T09:17:25.637 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T09:17:25.973 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2023-01-25T09:17:25.992 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../019-librgw2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:26.115 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs2. 2023-01-25T09:17:26.134 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:26.173 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:26.668 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rados. 2023-01-25T09:17:26.685 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../010-python3-rados_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:26.726 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:26.867 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2023-01-25T09:17:26.883 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:27.054 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-01-25T09:17:27.074 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:27.112 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:27.296 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0. 2023-01-25T09:17:27.313 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-01-25T09:17:27.322 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cephfs. 2023-01-25T09:17:27.342 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:27.354 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-01-25T09:17:27.372 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:27.607 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2023-01-25T09:17:27.624 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:27.656 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:27.717 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-common. 2023-01-25T09:17:27.733 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:27.798 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:28.112 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-prettytable. 2023-01-25T09:17:28.128 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-01-25T09:17:28.135 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2023-01-25T09:17:28.153 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../023-ceph-common_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:28.193 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:28.203 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-01-25T09:17:28.444 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rbd. 2023-01-25T09:17:28.462 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:28.504 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:28.873 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-01-25T09:17:28.896 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-01-25T09:17:28.951 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T09:17:29.268 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-01-25T09:17:29.284 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-01-25T09:17:29.351 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T09:17:29.671 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-01-25T09:17:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-01-25T09:17:29.746 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T09:17:30.115 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librgw2. 2023-01-25T09:17:30.134 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../019-librgw2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:30.173 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:30.665 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2023-01-25T09:17:30.684 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../024-ceph-base_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:30.733 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:31.169 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rgw. 2023-01-25T09:17:31.185 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:31.227 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:31.605 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liboath0. 2023-01-25T09:17:31.621 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-01-25T09:17:31.663 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-01-25T09:17:31.949 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libradosstriper1. 2023-01-25T09:17:31.967 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:32.008 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:32.078 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2023-01-25T09:17:32.094 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-01-25T09:17:32.136 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-01-25T09:17:32.411 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-common. 2023-01-25T09:17:32.430 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../023-ceph-common_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:32.494 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:32.497 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-natsort. 2023-01-25T09:17:32.513 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-01-25T09:17:32.555 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-01-25T09:17:32.867 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2023-01-25T09:17:32.882 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-01-25T09:17:32.933 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-01-25T09:17:33.195 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2023-01-25T09:17:33.213 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-01-25T09:17:33.253 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-01-25T09:17:33.497 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2023-01-25T09:17:33.516 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-01-25T09:17:33.597 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T09:17:33.884 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2023-01-25T09:17:33.903 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-01-25T09:17:33.942 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-01-25T09:17:34.278 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2023-01-25T09:17:34.296 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-01-25T09:17:34.336 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T09:17:34.639 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2023-01-25T09:17:34.658 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-01-25T09:17:34.697 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-01-25T09:17:35.050 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-soupsieve. 2023-01-25T09:17:35.066 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-01-25T09:17:35.108 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T09:17:35.225 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-base. 2023-01-25T09:17:35.243 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../024-ceph-base_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:35.294 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:35.411 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bs4. 2023-01-25T09:17:35.427 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-01-25T09:17:35.494 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-01-25T09:17:35.842 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2023-01-25T09:17:35.860 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-01-25T09:17:35.903 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T09:17:36.254 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2023-01-25T09:17:36.270 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-01-25T09:17:36.312 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-01-25T09:17:36.614 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2023-01-25T09:17:36.633 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-01-25T09:17:36.663 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cherrypy3. 2023-01-25T09:17:36.672 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T09:17:36.679 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-01-25T09:17:36.746 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-01-25T09:17:37.026 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-01-25T09:17:37.043 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-01-25T09:17:37.058 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-natsort. 2023-01-25T09:17:37.078 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-01-25T09:17:37.084 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T09:17:37.141 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-01-25T09:17:37.404 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2023-01-25T09:17:37.421 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-01-25T09:17:37.452 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-logutils. 2023-01-25T09:17:37.454 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-01-25T09:17:37.470 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-01-25T09:17:37.544 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-01-25T09:17:37.765 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2023-01-25T09:17:37.782 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-01-25T09:17:37.823 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-01-25T09:17:37.830 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-markupsafe. 2023-01-25T09:17:37.850 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-01-25T09:17:37.913 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-01-25T09:17:38.168 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2023-01-25T09:17:38.185 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-01-25T09:17:38.226 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T09:17:38.564 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2023-01-25T09:17:38.584 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-01-25T09:17:38.622 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T09:17:38.917 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-mako. 2023-01-25T09:17:38.933 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-01-25T09:17:38.975 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T09:17:39.311 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplegeneric. 2023-01-25T09:17:39.328 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-01-25T09:17:39.370 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-01-25T09:17:39.625 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-01-25T09:17:39.641 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:39.683 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:39.706 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-singledispatch. 2023-01-25T09:17:39.723 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-01-25T09:17:39.764 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T09:17:40.080 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-01-25T09:17:40.092 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webob. 2023-01-25T09:17:40.097 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:40.109 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-01-25T09:17:40.138 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:40.150 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-01-25T09:17:40.458 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cryptography. 2023-01-25T09:17:40.474 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-01-25T09:17:40.486 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-soupsieve. 2023-01-25T09:17:40.506 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-01-25T09:17:40.516 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T09:17:40.545 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T09:17:40.861 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2023-01-25T09:17:40.876 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-bs4. 2023-01-25T09:17:40.880 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-01-25T09:17:40.893 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-01-25T09:17:40.919 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-01-25T09:17:40.934 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-01-25T09:17:41.256 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2023-01-25T09:17:41.273 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:41.339 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:41.354 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-waitress. 2023-01-25T09:17:41.372 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-01-25T09:17:41.415 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T09:17:41.765 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-tempita. 2023-01-25T09:17:41.782 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-01-25T09:17:41.817 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2023-01-25T09:17:41.836 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:41.846 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-01-25T09:17:41.875 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:42.152 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-paste. 2023-01-25T09:17:42.168 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-01-25T09:17:42.233 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T09:17:42.555 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-01-25T09:17:42.574 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-01-25T09:17:42.647 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T09:17:42.958 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastedeploy. 2023-01-25T09:17:42.962 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2023-01-25T09:17:42.978 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-01-25T09:17:42.978 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:43.012 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:43.041 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-01-25T09:17:43.344 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webtest. 2023-01-25T09:17:43.361 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-01-25T09:17:43.428 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-01-25T09:17:43.722 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pecan. 2023-01-25T09:17:43.739 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-01-25T09:17:43.805 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T09:17:44.177 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-werkzeug. 2023-01-25T09:17:44.193 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-01-25T09:17:44.235 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T09:17:44.563 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-01-25T09:17:44.580 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:44.613 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:45.027 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-01-25T09:17:45.044 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:45.093 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:45.446 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cryptography. 2023-01-25T09:17:45.464 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-01-25T09:17:45.504 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T09:17:45.732 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2023-01-25T09:17:45.749 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../050-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:45.789 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:45.908 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-openssl. 2023-01-25T09:17:45.924 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-01-25T09:17:45.966 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-01-25T09:17:46.109 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2023-01-25T09:17:46.128 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:46.167 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:46.320 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr. 2023-01-25T09:17:46.338 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:46.378 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:46.587 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2023-01-25T09:17:46.607 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:46.637 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:46.890 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mon. 2023-01-25T09:17:46.905 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:46.948 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:47.182 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2023-01-25T09:17:47.199 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../053-cephadm_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:47.240 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:47.517 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-asyncssh. 2023-01-25T09:17:47.533 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-01-25T09:17:47.567 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-01-25T09:17:47.904 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2023-01-25T09:17:47.921 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-01-25T09:17:47.954 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-01-25T09:17:48.119 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-osd. 2023-01-25T09:17:48.136 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:48.177 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:48.281 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-01-25T09:17:48.297 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:48.339 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:48.693 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2023-01-25T09:17:48.712 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-01-25T09:17:48.751 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T09:17:49.062 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jwt. 2023-01-25T09:17:49.078 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-01-25T09:17:49.128 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T09:17:49.448 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-attr. 2023-01-25T09:17:49.465 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-01-25T09:17:49.506 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-01-25T09:17:49.934 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2023-01-25T09:17:49.950 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-01-25T09:17:49.992 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-01-25T09:17:50.304 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2023-01-25T09:17:50.319 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-01-25T09:17:50.387 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T09:17:50.690 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-atomicwrites. 2023-01-25T09:17:50.708 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-01-25T09:17:50.748 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T09:17:50.963 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph. 2023-01-25T09:17:50.980 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../050-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:51.017 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-packaging. 2023-01-25T09:17:51.021 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:51.035 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-01-25T09:17:51.067 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-packaging (20.3-1) ... 2023-01-25T09:17:51.365 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-fuse. 2023-01-25T09:17:51.370 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-wcwidth. 2023-01-25T09:17:51.381 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:51.388 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-01-25T09:17:51.423 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:51.428 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T09:17:51.756 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2023-01-25T09:17:51.775 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-01-25T09:17:51.814 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-01-25T09:17:51.819 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mds. 2023-01-25T09:17:51.836 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:51.869 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:52.168 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2023-01-25T09:17:52.185 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-01-25T09:17:52.226 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-01-25T09:17:52.380 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephadm. 2023-01-25T09:17:52.399 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../053-cephadm_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:17:52.438 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:52.504 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjs-underscore. 2023-01-25T09:17:52.519 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-01-25T09:17:52.562 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T09:17:52.839 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-01-25T09:17:52.857 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-01-25T09:17:52.897 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T09:17:52.908 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-asyncssh. 2023-01-25T09:17:52.924 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-01-25T09:17:52.966 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-01-25T09:17:53.200 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2023-01-25T09:17:53.219 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-01-25T09:17:53.258 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-01-25T09:17:53.361 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jinja2. 2023-01-25T09:17:53.377 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-01-25T09:17:53.419 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-01-25T09:17:53.628 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-01-25T09:17:53.645 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:53.686 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:53.755 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-01-25T09:17:53.775 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:53.813 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:54.182 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-decorator. 2023-01-25T09:17:54.200 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-01-25T09:17:54.248 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T09:17:54.526 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-01-25T09:17:54.542 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-01-25T09:17:54.544 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-bcrypt. 2023-01-25T09:17:54.561 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-01-25T09:17:54.584 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T09:17:54.602 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T09:17:54.939 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jwt. 2023-01-25T09:17:54.956 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-01-25T09:17:54.996 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T09:17:55.200 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-scipy. 2023-01-25T09:17:55.217 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-01-25T09:17:55.250 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-01-25T09:17:55.341 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-attr. 2023-01-25T09:17:55.359 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-01-25T09:17:55.399 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-01-25T09:17:55.727 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pluggy. 2023-01-25T09:17:55.744 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-01-25T09:17:55.785 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-01-25T09:17:56.055 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-py. 2023-01-25T09:17:56.075 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-01-25T09:17:56.113 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T09:17:56.458 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-atomicwrites. 2023-01-25T09:17:56.478 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-01-25T09:17:56.516 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T09:17:56.568 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-01-25T09:17:56.585 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-01-25T09:17:56.625 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T09:17:56.828 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-packaging. 2023-01-25T09:17:56.847 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-01-25T09:17:56.885 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-packaging (20.3-1) ... 2023-01-25T09:17:57.165 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2023-01-25T09:17:57.180 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-01-25T09:17:57.222 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-01-25T09:17:57.230 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-wcwidth. 2023-01-25T09:17:57.248 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-01-25T09:17:57.288 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T09:17:57.577 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2023-01-25T09:17:57.593 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-01-25T09:17:57.599 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pytest. 2023-01-25T09:17:57.619 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-01-25T09:17:57.657 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-01-25T09:17:57.660 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T09:17:58.036 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-repoze.lru. 2023-01-25T09:17:58.052 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-01-25T09:17:58.094 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-01-25T09:17:58.320 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-01-25T09:17:58.340 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:58.363 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjs-underscore. 2023-01-25T09:17:58.378 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:58.380 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-01-25T09:17:58.421 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T09:17:58.732 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-01-25T09:17:58.749 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-01-25T09:17:58.790 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T09:17:59.151 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-routes. 2023-01-25T09:17:59.168 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-01-25T09:17:59.211 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-01-25T09:17:59.481 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cachetools. 2023-01-25T09:17:59.498 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-01-25T09:17:59.563 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-01-25T09:17:59.583 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-01-25T09:17:59.584 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:17:59.620 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:17:59.850 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2023-01-25T09:17:59.866 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-01-25T09:17:59.908 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T09:18:00.113 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-decorator. 2023-01-25T09:18:00.129 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-01-25T09:18:00.163 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T09:18:00.253 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-01-25T09:18:00.270 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-01-25T09:18:00.320 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T09:18:00.466 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-01-25T09:18:00.482 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-01-25T09:18:00.524 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T09:18:00.691 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2023-01-25T09:18:00.709 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-01-25T09:18:00.749 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (4.0-3) ... 2023-01-25T09:18:00.852 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-scipy. 2023-01-25T09:18:00.871 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-01-25T09:18:00.910 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-01-25T09:18:01.096 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-google-auth. 2023-01-25T09:18:01.111 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-01-25T09:18:01.153 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-01-25T09:18:01.499 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-blinker. 2023-01-25T09:18:01.517 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-01-25T09:18:01.557 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T09:18:01.860 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-oauthlib. 2023-01-25T09:18:01.877 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-01-25T09:18:01.918 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T09:18:02.280 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-01-25T09:18:02.287 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-01-25T09:18:02.300 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-01-25T09:18:02.304 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-01-25T09:18:02.338 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T09:18:02.345 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T09:18:02.658 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2023-01-25T09:18:02.674 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-01-25T09:18:02.716 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T09:18:02.875 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-joblib. 2023-01-25T09:18:02.894 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-01-25T09:18:02.933 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-01-25T09:18:03.070 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2023-01-25T09:18:03.089 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-01-25T09:18:03.129 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T09:18:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn. 2023-01-25T09:18:03.347 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-01-25T09:18:03.387 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T09:18:03.734 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-01-25T09:18:03.750 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:18:03.792 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:04.136 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig5:amd64. 2023-01-25T09:18:04.146 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-01-25T09:18:04.154 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-01-25T09:18:04.164 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:18:04.194 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-01-25T09:18:04.221 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:04.547 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2023-01-25T09:18:04.563 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T09:18:04.605 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:18:04.900 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2023-01-25T09:18:04.917 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T09:18:04.958 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:18:05.194 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2023-01-25T09:18:05.210 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-01-25T09:18:05.252 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.3.3-2) ... 2023-01-25T09:18:05.365 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cachetools. 2023-01-25T09:18:05.386 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-01-25T09:18:05.448 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-01-25T09:18:05.605 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2023-01-25T09:18:05.622 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-01-25T09:18:05.663 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-01-25T09:18:05.735 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1. 2023-01-25T09:18:05.752 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-01-25T09:18:05.815 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T09:18:06.026 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2023-01-25T09:18:06.045 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../094-ceph-test_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:18:06.084 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:06.121 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-01-25T09:18:06.140 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-01-25T09:18:06.171 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T09:18:06.618 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rsa. 2023-01-25T09:18:06.638 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-01-25T09:18:06.676 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rsa (4.0-3) ... 2023-01-25T09:18:07.005 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-google-auth. 2023-01-25T09:18:07.023 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-01-25T09:18:07.063 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-01-25T09:18:07.400 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-blinker. 2023-01-25T09:18:07.419 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-01-25T09:18:07.458 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T09:18:07.786 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-oauthlib. 2023-01-25T09:18:07.803 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-01-25T09:18:07.844 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T09:18:08.215 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-01-25T09:18:08.232 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-01-25T09:18:08.273 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T09:18:08.607 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-websocket. 2023-01-25T09:18:08.624 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-01-25T09:18:08.665 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T09:18:09.006 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-kubernetes. 2023-01-25T09:18:09.022 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-01-25T09:18:09.064 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T09:18:09.683 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-01-25T09:18:09.700 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:18:09.774 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:10.094 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libonig5:amd64. 2023-01-25T09:18:10.115 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-01-25T09:18:10.176 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-01-25T09:18:10.330 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-volume. 2023-01-25T09:18:10.346 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../095-ceph-volume_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:18:10.388 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:10.572 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjq1:amd64. 2023-01-25T09:18:10.589 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T09:18:10.630 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:18:10.717 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package fonts-mathjax. 2023-01-25T09:18:10.734 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T09:18:10.776 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:18:10.925 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package jq. 2023-01-25T09:18:10.942 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T09:18:10.974 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:18:11.227 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package socat. 2023-01-25T09:18:11.244 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-01-25T09:18:11.318 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking socat (1.7.3.3-2) ... 2023-01-25T09:18:11.321 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2023-01-25T09:18:11.338 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:18:11.379 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:11.639 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package xmlstarlet. 2023-01-25T09:18:11.656 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-01-25T09:18:11.714 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-01-25T09:18:11.807 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2023-01-25T09:18:11.823 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-01-25T09:18:11.882 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T09:18:12.093 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-test. 2023-01-25T09:18:12.110 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../094-ceph-test_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:18:12.151 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:12.228 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-01-25T09:18:12.248 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-01-25T09:18:12.287 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-01-25T09:18:12.699 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjs-mathjax. 2023-01-25T09:18:12.718 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T09:18:12.757 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:18:14.432 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-natsort-doc. 2023-01-25T09:18:14.451 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-01-25T09:18:14.490 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-01-25T09:18:14.844 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webencodings. 2023-01-25T09:18:14.860 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-01-25T09:18:14.901 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T09:18:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-html5lib. 2023-01-25T09:18:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-01-25T09:18:15.304 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-01-25T09:18:15.632 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-01-25T09:18:15.652 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-01-25T09:18:15.715 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T09:18:16.193 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2023-01-25T09:18:16.210 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-01-25T09:18:16.251 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-01-25T09:18:16.564 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-volume. 2023-01-25T09:18:16.580 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-psutil. 2023-01-25T09:18:16.581 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../095-ceph-volume_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:18:16.600 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-01-25T09:18:16.622 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:16.638 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T09:18:16.976 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package fonts-mathjax. 2023-01-25T09:18:16.995 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T09:18:16.999 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2023-01-25T09:18:17.015 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-01-25T09:18:17.034 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:18:17.057 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T09:18:17.351 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2023-01-25T09:18:17.372 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-01-25T09:18:17.409 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T09:18:17.605 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs-dev. 2023-01-25T09:18:17.622 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:18:17.663 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:17.704 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-01-25T09:18:17.722 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-01-25T09:18:17.762 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T09:18:18.092 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package nvme-cli. 2023-01-25T09:18:18.109 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-01-25T09:18:18.167 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T09:18:18.457 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2023-01-25T09:18:18.477 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../110-radosgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:18:18.516 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:18.538 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-01-25T09:18:18.555 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-01-25T09:18:18.596 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-01-25T09:18:18.991 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjs-mathjax. 2023-01-25T09:18:19.011 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T09:18:19.049 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:18:19.885 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2023-01-25T09:18:19.903 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:18:19.943 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:20.235 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-attr (19.3.0-2) ... 2023-01-25T09:18:20.531 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T09:18:20.649 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T09:18:20.735 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-natsort-doc. 2023-01-25T09:18:20.754 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-01-25T09:18:20.767 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T09:18:20.826 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-01-25T09:18:21.001 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:21.188 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webencodings. 2023-01-25T09:18:21.207 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-01-25T09:18:21.245 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T09:18:21.582 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-html5lib. 2023-01-25T09:18:21.599 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-01-25T09:18:21.612 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2023-01-25T09:18:21.640 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-01-25T09:18:21.732 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:18:21.841 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T09:18:22.002 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-01-25T09:18:22.018 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-01-25T09:18:22.059 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T09:18:22.210 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-01-25T09:18:22.511 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:18:22.546 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastescript. 2023-01-25T09:18:22.567 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-01-25T09:18:22.604 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-01-25T09:18:22.637 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-01-25T09:18:22.763 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T09:18:22.966 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-psutil. 2023-01-25T09:18:22.987 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-01-25T09:18:23.024 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T09:18:23.122 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-01-25T09:18:23.394 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyinotify. 2023-01-25T09:18:23.413 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-01-25T09:18:23.452 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T09:18:23.507 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T09:18:23.784 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-01-25T09:18:23.796 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplejson. 2023-01-25T09:18:23.813 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-01-25T09:18:23.879 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T09:18:24.094 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T09:18:24.159 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-01-25T09:18:24.176 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-01-25T09:18:24.217 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T09:18:24.386 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T09:18:24.679 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:24.913 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package radosgw. 2023-01-25T09:18:24.932 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../110-radosgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:18:24.970 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:24.996 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T09:18:25.114 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-01-25T09:18:25.398 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T09:18:25.683 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T09:18:26.086 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T09:18:26.382 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package rbd-fuse. 2023-01-25T09:18:26.401 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:18:26.440 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:26.777 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-01-25T09:18:26.783 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-attr (19.3.0-2) ... 2023-01-25T09:18:27.086 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T09:18:27.170 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T09:18:27.321 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T09:18:27.412 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T09:18:27.447 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T09:18:27.640 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:27.772 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T09:18:28.064 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-01-25T09:18:28.285 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user cephadm....done 2023-01-25T09:18:28.382 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-01-25T09:18:28.471 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:18:28.606 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T09:18:28.700 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-packaging (20.3-1) ... 2023-01-25T09:18:28.974 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-01-25T09:18:29.001 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T09:18:29.127 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T09:18:29.253 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T09:18:29.334 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:18:29.460 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-01-25T09:18:29.554 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T09:18:29.586 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T09:18:29.929 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-01-25T09:18:29.952 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T09:18:30.341 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T09:18:30.415 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T09:18:30.685 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.3.3-2) ... 2023-01-25T09:18:30.691 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-01-25T09:18:30.794 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:31.009 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T09:18:31.128 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:18:31.288 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-01-25T09:18:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T09:18:31.603 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:31.630 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T09:18:31.757 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-01-25T09:18:31.896 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T09:18:31.916 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-01-25T09:18:32.038 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-01-25T09:18:32.201 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T09:18:32.331 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T09:18:32.485 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:18:32.628 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T09:18:32.632 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T09:18:32.754 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T09:18:32.799 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T09:18:33.080 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T09:18:33.192 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-01-25T09:18:33.373 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-01-25T09:18:33.510 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T09:18:33.666 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T09:18:33.800 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-01-25T09:18:33.803 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T09:18:34.052 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-01-25T09:18:34.171 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T09:18:34.319 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T09:18:34.480 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-01-25T09:18:34.620 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T09:18:34.815 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-01-25T09:18:34.981 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-01-25T09:18:35.107 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-packaging (20.3-1) ... 2023-01-25T09:18:35.231 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-01-25T09:18:35.357 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T09:18:35.434 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T09:18:35.560 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T09:18:35.684 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-01-25T09:18:35.694 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T09:18:36.003 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T09:18:36.035 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T09:18:36.136 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T09:18:36.262 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-01-25T09:18:36.388 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T09:18:36.605 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T09:18:36.756 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T09:18:36.889 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-01-25T09:18:37.116 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up socat (1.7.3.3-2) ... 2023-01-25T09:18:37.234 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:37.585 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:18:37.761 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-01-25T09:18:38.121 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T09:18:38.247 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-01-25T09:18:38.373 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-01-25T09:18:38.378 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:18:38.504 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-01-25T09:18:38.692 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T09:18:38.880 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-01-25T09:18:39.009 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:18:39.110 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T09:18:39.198 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-01-25T09:18:39.269 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T09:18:39.474 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:18:39.625 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-01-25T09:18:39.629 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T09:18:39.921 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-01-25T09:18:39.977 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T09:18:40.256 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T09:18:40.295 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-01-25T09:18:40.432 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-01-25T09:18:40.680 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T09:18:40.733 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-01-25T09:18:41.022 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T09:18:41.092 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T09:18:41.410 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T09:18:41.805 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-01-25T09:18:42.053 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T09:18:42.071 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-01-25T09:18:42.201 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-01-25T09:18:42.205 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T09:18:42.336 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:18:42.462 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (4.0-3) ... 2023-01-25T09:18:42.557 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-01-25T09:18:42.788 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T09:18:42.914 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-01-25T09:18:42.933 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T09:18:43.092 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T09:18:43.201 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-01-25T09:18:43.207 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T09:18:43.492 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-01-25T09:18:43.544 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T09:18:43.801 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T09:18:43.862 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-01-25T09:18:44.162 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:44.288 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-01-25T09:18:44.413 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:44.531 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:44.751 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.4.1-2) ... 2023-01-25T09:18:45.178 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:45.330 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-01-25T09:18:45.401 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:18:45.510 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-01-25T09:18:45.631 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:45.751 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:45.870 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:45.887 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-01-25T09:18:46.117 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T09:18:46.117 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T09:18:46.196 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-01-25T09:18:46.539 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:18:46.555 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:46.665 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-01-25T09:18:46.706 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:46.832 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T09:18:47.008 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T09:18:47.327 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-01-25T09:18:47.703 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T09:18:47.734 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:47.835 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:47.994 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:48.079 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T09:18:48.120 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:48.246 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:48.791 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2023-01-25T09:18:49.158 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2023-01-25T09:18:49.173 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T09:18:49.333 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-01-25T09:18:49.336 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2023-01-25T09:18:49.361 INFO:teuthology.orchestra.run.smithi106.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-01-25T09:18:49.459 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:18:49.512 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-01-25T09:18:49.618 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rsa (4.0-3) ... 2023-01-25T09:18:49.837 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-01-25T09:18:49.903 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T09:18:50.045 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-01-25T09:18:50.282 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:50.330 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T09:18:50.433 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:50.656 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-01-25T09:18:50.705 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T09:18:50.706 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T09:18:50.990 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T09:18:51.351 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librados2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:51.376 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:51.460 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-01-25T09:18:51.628 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:51.754 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:51.760 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-01-25T09:18:51.990 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:52.116 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-routes (2.4.1-2) ... 2023-01-25T09:18:52.228 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:52.420 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:52.487 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T09:18:52.488 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T09:18:52.548 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-01-25T09:18:52.850 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librbd1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:52.930 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:52.984 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:53.135 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:53.175 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T09:18:53.176 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T09:18:53.350 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T09:18:53.351 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T09:18:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:53.835 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:53.945 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:54.071 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T09:18:54.141 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T09:18:54.141 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T09:18:54.566 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:54.692 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:54.835 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:54.999 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:55.063 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T09:18:55.063 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T09:18:55.125 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:55.252 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:55.411 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:55.488 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:55.537 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:55.755 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:55.898 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:56.025 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-01-25T09:18:56.139 INFO:teuthology.orchestra.run.smithi019.stdout:Adding group ceph....done 2023-01-25T09:18:56.210 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-01-25T09:18:56.528 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-01-25T09:18:56.550 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user ceph....done 2023-01-25T09:18:56.727 INFO:teuthology.orchestra.run.smithi019.stdout:Setting system user ceph properties....done 2023-01-25T09:18:56.747 INFO:teuthology.orchestra.run.smithi019.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-01-25T09:18:56.905 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-01-25T09:18:57.228 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-01-25T09:18:57.714 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:57.840 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:58.115 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T09:18:58.116 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T09:18:58.817 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:59.168 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-01-25T09:18:59.331 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-01-25T09:18:59.627 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:18:59.864 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T09:18:59.865 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T09:18:59.928 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-01-25T09:18:59.931 DEBUG:teuthology.parallel:result is None 2023-01-25T09:19:00.352 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:00.592 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T09:19:00.592 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T09:19:01.251 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:02.025 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T09:19:02.025 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T09:19:02.483 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:02.601 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:02.760 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:02.993 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T09:19:02.993 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T09:19:03.428 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:03.604 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:03.747 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:03.923 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:19:04.050 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-01-25T09:19:04.201 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-01-25T09:19:04.495 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-01-25T09:19:07.507 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-01-25T09:19:08.102 INFO:teuthology.orchestra.run.smithi019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-01-25T09:19:08.104 DEBUG:teuthology.parallel:result is None 2023-01-25T09:19:08.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo lsb_release -is 2023-01-25T09:19:08.148 INFO:teuthology.orchestra.run.smithi019.stdout:Ubuntu 2023-01-25T09:19:08.154 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:19:08.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:19:08.395 DEBUG:teuthology.orchestra.run.smithi019:> dpkg-query -W -f '${Version}' ceph 2023-01-25T09:19:08.419 INFO:teuthology.orchestra.run.smithi019.stdout:18.0.0-1986-g44e4095d-1focal 2023-01-25T09:19:08.419 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:19:08.420 INFO:teuthology.task.install:The correct ceph version 18.0.0-1986-g44e4095d-1focal is installed. 2023-01-25T09:19:08.420 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2023-01-25T09:19:08.473 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2023-01-25T09:19:08.478 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:19:08.479 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:19:08.628 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2023-01-25T09:19:08.651 INFO:teuthology.orchestra.run.smithi106.stdout:18.0.0-1986-g44e4095d-1focal 2023-01-25T09:19:08.652 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:19:08.652 INFO:teuthology.task.install:The correct ceph version 18.0.0-1986-g44e4095d-1focal is installed. 2023-01-25T09:19:08.653 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T09:19:08.653 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:08.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T09:19:08.671 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:08.671 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T09:19:08.709 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T09:19:08.709 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:08.710 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T09:19:08.729 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T09:19:08.740 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:08.740 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T09:19:08.756 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T09:19:08.812 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T09:19:08.812 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:08.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T09:19:08.829 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T09:19:08.884 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:08.885 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T09:19:08.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T09:19:08.956 INFO:teuthology.run_tasks:Running task ceph... 2023-01-25T09:19:09.022 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-25T09:19:09.023 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2023-01-25T09:19:09.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2023-01-25T09:19:09.041 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-25T09:19:09.041 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T09:19:09.083 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T09:19:09.099 INFO:tasks.ceph:Creating extra log directories... 2023-01-25T09:19:09.099 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T09:19:09.102 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T09:19:09.173 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-25T09:19:09.173 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-25T09:19:09.174 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137154', 'branch': 'wip-yuri6-testing-2023-01-24-0746', 'description': 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7137154', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}, {'machine': {'ram': 15000}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2023-01-24-0746'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-yuri6-testing-2023-01-24-0746', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2023-01-24-0746', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'targets': {'smithi019.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi106.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'cluster': 'ceph'}}, {'thrashosds': {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 3600', 'sudo ceph osd pool set cache target_max_objects 250', 'sudo ceph osd pool set cache min_read_recency_for_promote 0', 'sudo ceph osd pool set cache min_write_recency_for_promote 0']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'cache_evict': 50, 'cache_flush': 50, 'cache_try_flush': 50, 'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000, 'pool_snaps': True, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_22:27:30', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-25T09:19:09.175 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T09:19:09.177 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T09:19:09.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T09:19:09.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T09:19:09.243 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:09.244 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T09:19:09.249 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T09:19:09.250 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2023-01-25T09:19:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T09:19:09.256 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:19:09.256 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-01-25T09:19:09.257 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:19:09.257 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-01-25 09:15:36.912458384 +0000 2023-01-25T09:19:09.257 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-01-25 09:15:36.648464458 +0000 2023-01-25T09:19:09.257 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-01-25 09:15:36.648464458 +0000 2023-01-25T09:19:09.258 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2023-01-25T09:19:09.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T09:19:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-01-25T09:19:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-01-25T09:19:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000418968 s, 1.2 MB/s 2023-01-25T09:19:09.311 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T09:19:09.319 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2023-01-25T09:19:09.325 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T09:19:09.326 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:19:09.326 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-01-25T09:19:09.326 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:19:09.326 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-01-25 09:15:37.148452954 +0000 2023-01-25T09:19:09.327 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-01-25 09:15:37.144453048 +0000 2023-01-25T09:19:09.327 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-01-25 09:15:37.144453048 +0000 2023-01-25T09:19:09.327 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2023-01-25T09:19:09.327 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T09:19:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-01-25T09:19:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-01-25T09:19:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00043383 s, 1.2 MB/s 2023-01-25T09:19:09.341 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T09:19:09.394 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2023-01-25T09:19:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T09:19:09.402 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:19:09.402 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-01-25T09:19:09.402 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:19:09.403 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-01-25 09:15:37.916435285 +0000 2023-01-25T09:19:09.403 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-01-25 09:15:37.648441452 +0000 2023-01-25T09:19:09.403 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-01-25 09:15:37.648441452 +0000 2023-01-25T09:19:09.403 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2023-01-25T09:19:09.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T09:19:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-01-25T09:19:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-01-25T09:19:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000395192 s, 1.3 MB/s 2023-01-25T09:19:09.417 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T09:19:09.425 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2023-01-25T09:19:09.432 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T09:19:09.433 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:19:09.433 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-01-25T09:19:09.433 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:19:09.433 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-01-25 09:15:38.412423874 +0000 2023-01-25T09:19:09.434 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-01-25 09:15:38.136430224 +0000 2023-01-25T09:19:09.434 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-01-25 09:15:38.136430224 +0000 2023-01-25T09:19:09.434 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2023-01-25T09:19:09.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T09:19:09.488 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-01-25T09:19:09.488 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-01-25T09:19:09.488 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000405551 s, 1.3 MB/s 2023-01-25T09:19:09.489 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T09:19:09.496 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:09.497 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:09.497 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T09:19:09.504 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T09:19:09.504 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2023-01-25T09:19:09.511 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T09:19:09.512 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:19:09.512 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-01-25T09:19:09.512 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:19:09.512 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-01-25 09:15:37.060788123 +0000 2023-01-25T09:19:09.512 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-01-25 09:15:36.784794481 +0000 2023-01-25T09:19:09.513 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-01-25 09:15:36.784794481 +0000 2023-01-25T09:19:09.513 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-01-25T09:19:09.513 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T09:19:09.524 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-01-25T09:19:09.525 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-01-25T09:19:09.525 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000411881 s, 1.2 MB/s 2023-01-25T09:19:09.526 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T09:19:09.533 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2023-01-25T09:19:09.580 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T09:19:09.581 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:19:09.581 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-01-25T09:19:09.581 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:19:09.581 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-01-25 09:15:37.532777248 +0000 2023-01-25T09:19:09.582 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-01-25 09:15:37.296782685 +0000 2023-01-25T09:19:09.582 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-01-25 09:15:37.296782685 +0000 2023-01-25T09:19:09.582 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-01-25T09:19:09.582 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T09:19:09.593 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-01-25T09:19:09.593 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-01-25T09:19:09.594 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000390381 s, 1.3 MB/s 2023-01-25T09:19:09.595 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T09:19:09.603 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2023-01-25T09:19:09.608 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T09:19:09.609 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:19:09.609 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-01-25T09:19:09.609 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:19:09.609 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-01-25 09:15:37.760771995 +0000 2023-01-25T09:19:09.609 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-01-25 09:15:37.756772088 +0000 2023-01-25T09:19:09.610 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-01-25 09:15:37.756772088 +0000 2023-01-25T09:19:09.610 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-01-25T09:19:09.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T09:19:09.664 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-01-25T09:19:09.665 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-01-25T09:19:09.665 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000417821 s, 1.2 MB/s 2023-01-25T09:19:09.666 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T09:19:09.673 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2023-01-25T09:19:09.679 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T09:19:09.679 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:19:09.680 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-01-25T09:19:09.680 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:19:09.680 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-01-25 09:15:38.508754763 +0000 2023-01-25T09:19:09.680 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-01-25 09:15:38.248760753 +0000 2023-01-25T09:19:09.680 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-01-25 09:15:38.248760753 +0000 2023-01-25T09:19:09.681 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-01-25T09:19:09.681 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T09:19:09.736 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-01-25T09:19:09.737 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-01-25T09:19:09.737 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000421084 s, 1.2 MB/s 2023-01-25T09:19:09.738 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T09:19:09.745 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:09.745 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T09:19:09.746 INFO:tasks.ceph:Generating config... 2023-01-25T09:19:09.747 INFO:tasks.ceph:[osd] debug monc = 20 2023-01-25T09:19:09.747 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2023-01-25T09:19:09.747 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2023-01-25T09:19:09.748 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-25T09:19:09.748 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-25T09:19:09.748 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-25T09:19:09.749 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-25T09:19:09.749 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-25T09:19:09.749 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-25T09:19:09.749 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-25T09:19:09.750 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-25T09:19:09.750 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-25T09:19:09.750 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-25T09:19:09.750 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-25T09:19:09.751 INFO:tasks.ceph:[osd] osd backoff on peering = True 2023-01-25T09:19:09.751 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-01-25T09:19:09.751 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2023-01-25T09:19:09.752 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-25T09:19:09.752 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-25T09:19:09.752 INFO:tasks.ceph:[osd] osd delete sleep = 1 2023-01-25T09:19:09.752 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-25T09:19:09.753 INFO:tasks.ceph:[osd] osd max backfills = 3 2023-01-25T09:19:09.753 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-25T09:19:09.753 INFO:tasks.ceph:[osd] osd max scrubs = 2 2023-01-25T09:19:09.753 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-25T09:19:09.754 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-25T09:19:09.754 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-25T09:19:09.754 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-25T09:19:09.755 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2023-01-25T09:19:09.755 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2023-01-25T09:19:09.755 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-25T09:19:09.755 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2023-01-25T09:19:09.756 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2023-01-25T09:19:09.756 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2023-01-25T09:19:09.756 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-01-25T09:19:09.756 INFO:tasks.ceph:[global] mon election default strategy = 3 2023-01-25T09:19:09.757 INFO:tasks.ceph:[global] ms bind msgr1 = False 2023-01-25T09:19:09.757 INFO:tasks.ceph:[global] ms bind msgr2 = True 2023-01-25T09:19:09.757 INFO:tasks.ceph:[global] ms inject delay max = 1 2023-01-25T09:19:09.757 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2023-01-25T09:19:09.758 INFO:tasks.ceph:[global] ms inject delay type = osd 2023-01-25T09:19:09.758 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2023-01-25T09:19:09.758 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2023-01-25T09:19:09.759 INFO:tasks.ceph:[global] ms type = async 2023-01-25T09:19:09.759 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 2 2023-01-25T09:19:09.759 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 1 2023-01-25T09:19:09.759 INFO:tasks.ceph:[global] osd_pg_log_trim_min = 0 2023-01-25T09:19:09.760 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2023-01-25T09:19:09.760 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2023-01-25T09:19:09.760 INFO:tasks.ceph:[global] osd_recovery_max_active = 10 2023-01-25T09:19:09.760 INFO:tasks.ceph:[global] osd_recovery_max_single_start = 10 2023-01-25T09:19:09.761 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-25T09:19:09.761 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-25T09:19:09.761 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-25T09:19:09.761 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-25T09:19:09.762 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-25T09:19:09.762 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-01-25T09:19:09.762 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-01-25T09:19:09.763 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-01-25T09:19:09.763 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-01-25T09:19:09.763 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-25T09:19:09.763 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-01-25T09:19:09.764 INFO:tasks.ceph:Setting up mon.a... 2023-01-25T09:19:09.764 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-25T09:19:09.805 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2023-01-25T09:19:09.818 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-25T09:19:09.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:19:09.917 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.c', '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]'), ('mon.b', '172.21.15.106')] 2023-01-25T09:19:09.918 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.106', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-25T09:19:09.919 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:09.919 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T09:19:09.924 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --addv c '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]' --add b 172.21.15.106 --print /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:10.011 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:10.012 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1 2023-01-25T09:19:10.012 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = pacific 2023-01-25T09:19:10.012 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2023-01-25T09:19:10.012 INFO:teuthology.orchestra.run.smithi019.stdout:fsid ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1 2023-01-25T09:19:10.013 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2023-01-25T09:19:10.008871+0000 2023-01-25T09:19:10.013 INFO:teuthology.orchestra.run.smithi019.stdout:created 2023-01-25T09:19:10.008871+0000 2023-01-25T09:19:10.013 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 16 (pacific) 2023-01-25T09:19:10.013 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 3 2023-01-25T09:19:10.013 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2023-01-25T09:19:10.014 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.b 2023-01-25T09:19:10.014 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2023-01-25T09:19:10.014 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-25T09:19:10.015 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T09:19:10.021 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1... 2023-01-25T09:19:10.022 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T09:19:10.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T09:19:10.058 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2023-01-25T09:19:10.058 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2023-01-25T09:19:10.058 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T09:19:10.059 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2023-01-25T09:19:10.059 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.059 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2023-01-25T09:19:10.059 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.059 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2023-01-25T09:19:10.060 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.060 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2023-01-25T09:19:10.060 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2023-01-25T09:19:10.060 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.060 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2023-01-25T09:19:10.061 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2023-01-25T09:19:10.061 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.061 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T09:19:10.062 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2023-01-25T09:19:10.062 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.062 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T09:19:10.063 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T09:19:10.063 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.063 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2023-01-25T09:19:10.064 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.064 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2023-01-25T09:19:10.065 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2023-01-25T09:19:10.065 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2023-01-25T09:19:10.065 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2023-01-25T09:19:10.066 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2023-01-25T09:19:10.066 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2023-01-25T09:19:10.066 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2023-01-25T09:19:10.067 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T09:19:10.067 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T09:19:10.068 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2023-01-25T09:19:10.068 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.068 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T09:19:10.069 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.069 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2023-01-25T09:19:10.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.070 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2023-01-25T09:19:10.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.071 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2023-01-25T09:19:10.071 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2023-01-25T09:19:10.072 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2023-01-25T09:19:10.072 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.106" 2023-01-25T09:19:10.072 INFO:teuthology.orchestra.run.smithi019.stdout: mon client directed command retry = 5 2023-01-25T09:19:10.073 INFO:teuthology.orchestra.run.smithi019.stdout: mon election default strategy = 3 2023-01-25T09:19:10.073 INFO:teuthology.orchestra.run.smithi019.stdout: ms bind msgr1 = False 2023-01-25T09:19:10.074 INFO:teuthology.orchestra.run.smithi019.stdout: ms bind msgr2 = True 2023-01-25T09:19:10.074 INFO:teuthology.orchestra.run.smithi019.stdout: ms inject delay max = 1 2023-01-25T09:19:10.074 INFO:teuthology.orchestra.run.smithi019.stdout: ms inject delay probability = 0.005 2023-01-25T09:19:10.075 INFO:teuthology.orchestra.run.smithi019.stdout: ms inject delay type = osd 2023-01-25T09:19:10.075 INFO:teuthology.orchestra.run.smithi019.stdout: ms inject internal delays = 0.002 2023-01-25T09:19:10.075 INFO:teuthology.orchestra.run.smithi019.stdout: ms inject socket failures = 2500 2023-01-25T09:19:10.076 INFO:teuthology.orchestra.run.smithi019.stdout: ms type = async 2023-01-25T09:19:10.076 INFO:teuthology.orchestra.run.smithi019.stdout: osd_max_pg_log_entries = 2 2023-01-25T09:19:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: osd_min_pg_log_entries = 1 2023-01-25T09:19:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pg_log_trim_min = 0 2023-01-25T09:19:10.077 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_min_size = 2 2023-01-25T09:19:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_size = 3 2023-01-25T09:19:10.078 INFO:teuthology.orchestra.run.smithi019.stdout: osd_recovery_max_active = 10 2023-01-25T09:19:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: osd_recovery_max_single_start = 10 2023-01-25T09:19:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1 2023-01-25T09:19:10.079 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.080 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2023-01-25T09:19:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2023-01-25T09:19:10.080 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2023-01-25T09:19:10.081 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 120 2023-01-25T09:19:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2023-01-25T09:19:10.082 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2023-01-25T09:19:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.083 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2023-01-25T09:19:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2023-01-25T09:19:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2023-01-25T09:19:10.084 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2023-01-25T09:19:10.085 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2023-01-25T09:19:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2023-01-25T09:19:10.086 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2023-01-25T09:19:10.087 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2023-01-25T09:19:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.088 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2023-01-25T09:19:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2023-01-25T09:19:10.089 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2023-01-25T09:19:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2023-01-25T09:19:10.090 INFO:teuthology.orchestra.run.smithi019.stdout: debug monc = 20 2023-01-25T09:19:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: bluefs allocator = hybrid 2023-01-25T09:19:10.091 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = hybrid 2023-01-25T09:19:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2023-01-25T09:19:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2023-01-25T09:19:10.092 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore zero block detection = True 2023-01-25T09:19:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 20 2023-01-25T09:19:10.093 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 20 2023-01-25T09:19:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-01-25T09:19:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2023-01-25T09:19:10.094 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 10 2023-01-25T09:19:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T09:19:10.095 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2023-01-25T09:19:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2023-01-25T09:19:10.096 INFO:teuthology.orchestra.run.smithi019.stdout: osd backoff on peering = True 2023-01-25T09:19:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: osd blocked scrub grace period = 3600 2023-01-25T09:19:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug reject backfill probability = 0.3 2023-01-25T09:19:10.097 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify cached snaps = True 2023-01-25T09:19:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify missing on start = True 2023-01-25T09:19:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: osd delete sleep = 1 2023-01-25T09:19:10.098 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2023-01-25T09:19:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: osd max backfills = 3 2023-01-25T09:19:10.099 INFO:teuthology.orchestra.run.smithi019.stdout: osd max markdown count = 1000 2023-01-25T09:19:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: osd max scrubs = 2 2023-01-25T09:19:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock override recovery settings = True 2023-01-25T09:19:10.100 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2023-01-25T09:19:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: osd op queue = debug_random 2023-01-25T09:19:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: osd op queue cut off = debug_random 2023-01-25T09:19:10.101 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub min interval = 60 2023-01-25T09:19:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: osd shutdown pgref assert = True 2023-01-25T09:19:10.102 INFO:teuthology.orchestra.run.smithi019.stdout: osd snap trim sleep = 2 2023-01-25T09:19:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: osd_max_pg_log_entries = 3000 2023-01-25T09:19:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: osd_min_pg_log_entries = 3000 2023-01-25T09:19:10.103 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.104 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2023-01-25T09:19:10.104 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-01-25T09:19:10.105 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2023-01-25T09:19:10.105 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2023-01-25T09:19:10.105 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2023-01-25T09:19:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:19:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:19:10.106 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2023-01-25T09:19:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.107 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2023-01-25T09:19:10.107 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-01-25T09:19:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2023-01-25T09:19:10.108 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2023-01-25T09:19:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2023-01-25T09:19:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2023-01-25T09:19:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2023-01-25T09:19:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:19:10.110 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2023-01-25T09:19:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2023-01-25T09:19:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:19:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T09:19:10.112 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T09:19:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T09:19:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.113 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T09:19:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T09:19:10.114 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T09:19:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2023-01-25T09:19:10.115 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2023-01-25T09:19:10.116 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.116 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2023-01-25T09:19:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: mon min osdmap epochs = 50 2023-01-25T09:19:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: mon osdmap full prune interval = 2 2023-01-25T09:19:10.117 INFO:teuthology.orchestra.run.smithi019.stdout: mon osdmap full prune min = 15 2023-01-25T09:19:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: mon osdmap full prune txsize = 2 2023-01-25T09:19:10.118 INFO:teuthology.orchestra.run.smithi019.stdout: mon scrub interval = 300 2023-01-25T09:19:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: paxos service trim min = 10 2023-01-25T09:19:10.119 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:10.119 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2023-01-25T09:19:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2023-01-25T09:19:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2023-01-25T09:19:10.120 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2023-01-25T09:19:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T09:19:10.121 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T09:19:10.121 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2023-01-25T09:19:10.122 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2023-01-25T09:19:10.122 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2023-01-25T09:19:10.125 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2023-01-25T09:19:10.126 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2023-01-25T09:19:10.126 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T09:19:10.126 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2023-01-25T09:19:10.127 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.127 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2023-01-25T09:19:10.127 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.127 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2023-01-25T09:19:10.127 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.128 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2023-01-25T09:19:10.128 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2023-01-25T09:19:10.128 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.128 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2023-01-25T09:19:10.129 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2023-01-25T09:19:10.129 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.129 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T09:19:10.129 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2023-01-25T09:19:10.129 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.129 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T09:19:10.130 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T09:19:10.130 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.130 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2023-01-25T09:19:10.130 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.130 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2023-01-25T09:19:10.131 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2023-01-25T09:19:10.131 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2023-01-25T09:19:10.131 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2023-01-25T09:19:10.131 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2023-01-25T09:19:10.132 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2023-01-25T09:19:10.132 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2023-01-25T09:19:10.132 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T09:19:10.132 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T09:19:10.132 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2023-01-25T09:19:10.133 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.133 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T09:19:10.133 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.133 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2023-01-25T09:19:10.133 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.134 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2023-01-25T09:19:10.134 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.134 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2023-01-25T09:19:10.134 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2023-01-25T09:19:10.134 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2023-01-25T09:19:10.134 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.106" 2023-01-25T09:19:10.135 INFO:teuthology.orchestra.run.smithi106.stdout: mon client directed command retry = 5 2023-01-25T09:19:10.135 INFO:teuthology.orchestra.run.smithi106.stdout: mon election default strategy = 3 2023-01-25T09:19:10.135 INFO:teuthology.orchestra.run.smithi106.stdout: ms bind msgr1 = False 2023-01-25T09:19:10.136 INFO:teuthology.orchestra.run.smithi106.stdout: ms bind msgr2 = True 2023-01-25T09:19:10.136 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay max = 1 2023-01-25T09:19:10.136 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay probability = 0.005 2023-01-25T09:19:10.136 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay type = osd 2023-01-25T09:19:10.136 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject internal delays = 0.002 2023-01-25T09:19:10.137 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject socket failures = 2500 2023-01-25T09:19:10.137 INFO:teuthology.orchestra.run.smithi106.stdout: ms type = async 2023-01-25T09:19:10.137 INFO:teuthology.orchestra.run.smithi106.stdout: osd_max_pg_log_entries = 2 2023-01-25T09:19:10.137 INFO:teuthology.orchestra.run.smithi106.stdout: osd_min_pg_log_entries = 1 2023-01-25T09:19:10.138 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pg_log_trim_min = 0 2023-01-25T09:19:10.138 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_min_size = 2 2023-01-25T09:19:10.138 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_size = 3 2023-01-25T09:19:10.138 INFO:teuthology.orchestra.run.smithi106.stdout: osd_recovery_max_active = 10 2023-01-25T09:19:10.138 INFO:teuthology.orchestra.run.smithi106.stdout: osd_recovery_max_single_start = 10 2023-01-25T09:19:10.138 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1 2023-01-25T09:19:10.139 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.139 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2023-01-25T09:19:10.139 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2023-01-25T09:19:10.139 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.139 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2023-01-25T09:19:10.140 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 120 2023-01-25T09:19:10.140 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.140 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2023-01-25T09:19:10.140 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2023-01-25T09:19:10.140 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.141 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2023-01-25T09:19:10.141 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2023-01-25T09:19:10.141 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2023-01-25T09:19:10.141 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.141 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2023-01-25T09:19:10.142 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2023-01-25T09:19:10.142 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.142 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2023-01-25T09:19:10.142 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.143 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2023-01-25T09:19:10.143 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.143 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2023-01-25T09:19:10.143 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.143 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2023-01-25T09:19:10.144 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2023-01-25T09:19:10.144 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.144 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2023-01-25T09:19:10.144 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2023-01-25T09:19:10.144 INFO:teuthology.orchestra.run.smithi106.stdout: debug monc = 20 2023-01-25T09:19:10.145 INFO:teuthology.orchestra.run.smithi106.stdout: bluefs allocator = hybrid 2023-01-25T09:19:10.145 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = hybrid 2023-01-25T09:19:10.145 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2023-01-25T09:19:10.145 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2023-01-25T09:19:10.145 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore zero block detection = True 2023-01-25T09:19:10.146 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2023-01-25T09:19:10.146 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2023-01-25T09:19:10.146 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-01-25T09:19:10.146 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2023-01-25T09:19:10.146 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2023-01-25T09:19:10.147 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T09:19:10.147 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2023-01-25T09:19:10.147 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2023-01-25T09:19:10.147 INFO:teuthology.orchestra.run.smithi106.stdout: osd backoff on peering = True 2023-01-25T09:19:10.147 INFO:teuthology.orchestra.run.smithi106.stdout: osd blocked scrub grace period = 3600 2023-01-25T09:19:10.148 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug reject backfill probability = 0.3 2023-01-25T09:19:10.148 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify cached snaps = True 2023-01-25T09:19:10.148 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify missing on start = True 2023-01-25T09:19:10.148 INFO:teuthology.orchestra.run.smithi106.stdout: osd delete sleep = 1 2023-01-25T09:19:10.148 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2023-01-25T09:19:10.149 INFO:teuthology.orchestra.run.smithi106.stdout: osd max backfills = 3 2023-01-25T09:19:10.149 INFO:teuthology.orchestra.run.smithi106.stdout: osd max markdown count = 1000 2023-01-25T09:19:10.149 INFO:teuthology.orchestra.run.smithi106.stdout: osd max scrubs = 2 2023-01-25T09:19:10.149 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock override recovery settings = True 2023-01-25T09:19:10.150 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2023-01-25T09:19:10.150 INFO:teuthology.orchestra.run.smithi106.stdout: osd op queue = debug_random 2023-01-25T09:19:10.150 INFO:teuthology.orchestra.run.smithi106.stdout: osd op queue cut off = debug_random 2023-01-25T09:19:10.150 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub min interval = 60 2023-01-25T09:19:10.150 INFO:teuthology.orchestra.run.smithi106.stdout: osd shutdown pgref assert = True 2023-01-25T09:19:10.151 INFO:teuthology.orchestra.run.smithi106.stdout: osd snap trim sleep = 2 2023-01-25T09:19:10.151 INFO:teuthology.orchestra.run.smithi106.stdout: osd_max_pg_log_entries = 3000 2023-01-25T09:19:10.151 INFO:teuthology.orchestra.run.smithi106.stdout: osd_min_pg_log_entries = 3000 2023-01-25T09:19:10.152 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.152 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2023-01-25T09:19:10.153 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-01-25T09:19:10.153 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2023-01-25T09:19:10.153 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2023-01-25T09:19:10.153 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2023-01-25T09:19:10.154 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:19:10.154 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:19:10.154 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2023-01-25T09:19:10.154 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.154 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2023-01-25T09:19:10.155 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-01-25T09:19:10.155 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2023-01-25T09:19:10.155 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2023-01-25T09:19:10.155 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2023-01-25T09:19:10.155 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2023-01-25T09:19:10.156 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2023-01-25T09:19:10.156 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:19:10.156 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2023-01-25T09:19:10.156 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2023-01-25T09:19:10.156 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:19:10.157 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.157 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T09:19:10.157 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T09:19:10.157 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T09:19:10.157 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.158 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T09:19:10.158 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T09:19:10.158 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T09:19:10.158 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.158 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2023-01-25T09:19:10.159 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2023-01-25T09:19:10.159 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.159 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2023-01-25T09:19:10.159 INFO:teuthology.orchestra.run.smithi106.stdout: mon min osdmap epochs = 50 2023-01-25T09:19:10.159 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune interval = 2 2023-01-25T09:19:10.159 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune min = 15 2023-01-25T09:19:10.160 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune txsize = 2 2023-01-25T09:19:10.160 INFO:teuthology.orchestra.run.smithi106.stdout: mon scrub interval = 300 2023-01-25T09:19:10.160 INFO:teuthology.orchestra.run.smithi106.stdout: paxos service trim min = 10 2023-01-25T09:19:10.160 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-01-25T09:19:10.161 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2023-01-25T09:19:10.161 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2023-01-25T09:19:10.161 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2023-01-25T09:19:10.161 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2023-01-25T09:19:10.161 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T09:19:10.161 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T09:19:10.162 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2023-01-25T09:19:10.162 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2023-01-25T09:19:10.162 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2023-01-25T09:19:10.162 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-25T09:19:10.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-25T09:19:10.223 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-25T09:19:10.223 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:10.224 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-25T09:19:10.229 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:10.229 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-25T09:19:10.234 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2023-01-25T09:19:10.235 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:10.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T09:19:10.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:19:10.257 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:10.257 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:10.263 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2023-01-25T09:19:10.263 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:10.264 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T09:19:10.264 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:19:10.291 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:10.291 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:10.296 INFO:tasks.ceph:Setting up mon nodes... 2023-01-25T09:19:10.297 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-25T09:19:10.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T09:19:10.357 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T09:19:10.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T09:19:10.412 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T09:19:10.431 INFO:tasks.ceph:Setting up mds nodes... 2023-01-25T09:19:10.431 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-25T09:19:10.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-25T09:19:10.476 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-25T09:19:10.491 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-25T09:19:10.533 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-25T09:19:10.547 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-25T09:19:10.547 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T09:19:10.547 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-25T09:19:10.562 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:10.563 INFO:tasks.ceph:role: osd.0 2023-01-25T09:19:10.563 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2023-01-25T09:19:10.563 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T09:19:11.096 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:19:11.096 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:19:11.097 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:19:11.097 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 2023-01-25T09:19:11.097 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:19:11.097 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:19:11.098 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:19:11.098 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:19:11.098 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:19:11.098 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:19:11.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-01-25T09:19:11.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-25T09:19:11.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-25T09:19:11.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:19:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:19:11.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-25T09:19:11.234 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:11.234 INFO:tasks.ceph:role: osd.1 2023-01-25T09:19:11.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2023-01-25T09:19:11.234 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T09:19:11.772 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:19:11.773 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:19:11.773 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:19:11.773 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 2023-01-25T09:19:11.773 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:19:11.774 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:19:11.774 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:19:11.774 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:19:11.774 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:19:11.774 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:19:11.775 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-01-25T09:19:11.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-25T09:19:11.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-25T09:19:11.823 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:19:11.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:19:11.825 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-25T09:19:11.886 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:11.887 INFO:tasks.ceph:role: osd.2 2023-01-25T09:19:11.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2023-01-25T09:19:11.887 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T09:19:12.384 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:19:12.385 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:19:12.385 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:19:12.385 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 2023-01-25T09:19:12.385 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:19:12.386 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:19:12.386 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:19:12.386 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:19:12.386 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:19:12.386 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:19:12.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-01-25T09:19:12.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-25T09:19:12.437 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-25T09:19:12.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:19:12.448 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:19:12.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-25T09:19:12.505 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:12.506 INFO:tasks.ceph:role: osd.3 2023-01-25T09:19:12.506 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2023-01-25T09:19:12.506 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T09:19:13.015 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:19:13.015 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:19:13.016 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:19:13.016 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 2023-01-25T09:19:13.016 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:19:13.016 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:19:13.017 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:19:13.017 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:19:13.017 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:19:13.017 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:19:13.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-01-25T09:19:13.019 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-25T09:19:13.079 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-25T09:19:13.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:19:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:19:13.092 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:13.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:13.156+0000 7f3cc9296640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-25T09:19:13.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:13.160+0000 7f3cc9296640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-25T09:19:13.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:13.160+0000 7f3cc9296640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:19:13.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:13.160+0000 7f3cc9296640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:19:13.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:13.160+0000 7f3cc9296640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:19:13.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:13.168+0000 7f3cc9296640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-25T09:19:13.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:13.976+0000 7f3cc9296640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:14.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:14.755+0000 7f3cc9296640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:15.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:15.535+0000 7f3cc9296640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:16.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-25T09:19:16.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:16.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:16.471+0000 7f8b3060f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-25T09:19:16.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:16.471+0000 7f8b3060f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-25T09:19:16.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:16.471+0000 7f8b3060f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:19:16.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:16.471+0000 7f8b3060f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:19:16.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:16.471+0000 7f8b3060f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:19:16.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:16.475+0000 7f8b3060f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-25T09:19:17.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:17.051+0000 7f8b3060f640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:17.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:17.835+0000 7f8b3060f640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:18.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:18.623+0000 7f8b3060f640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:19.485 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-25T09:19:19.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:19.579+0000 7f70e2b3e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-25T09:19:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:19.579+0000 7f70e2b3e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-25T09:19:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:19.579+0000 7f70e2b3e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:19:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:19.579+0000 7f70e2b3e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:19:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:19.579+0000 7f70e2b3e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:19:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:19.579+0000 7f70e2b3e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-25T09:19:20.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:20.143+0000 7f70e2b3e640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:20.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:20.919+0000 7f70e2b3e640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:21.711+0000 7f70e2b3e640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:22.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-25T09:19:22.594 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:22.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:22.627+0000 7fcfd7fdb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-25T09:19:22.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:22.627+0000 7fcfd7fdb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-25T09:19:22.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:22.627+0000 7fcfd7fdb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:19:22.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:22.627+0000 7fcfd7fdb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:19:22.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:22.627+0000 7fcfd7fdb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:19:22.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:22.627+0000 7fcfd7fdb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-25T09:19:23.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:23.195+0000 7fcfd7fdb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:23.995+0000 7fcfd7fdb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:19:24.783+0000 7fcfd7fdb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:25.656 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-25T09:19:25.672 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-25T09:19:25.690 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:25.690 INFO:tasks.ceph:role: osd.4 2023-01-25T09:19:25.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2023-01-25T09:19:25.691 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T09:19:26.275 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:19:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:19:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:19:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 2023-01-25T09:19:26.277 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:19:26.277 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:19:26.277 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:19:26.278 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:19:26.278 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:19:26.278 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:19:26.279 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-01-25T09:19:26.280 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-25T09:19:26.388 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-25T09:19:26.400 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:19:26.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:19:26.402 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-25T09:19:26.412 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:26.413 INFO:tasks.ceph:role: osd.5 2023-01-25T09:19:26.413 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2023-01-25T09:19:26.413 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T09:19:26.946 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:19:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:19:26.946 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:19:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 2023-01-25T09:19:26.947 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:19:26.947 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:19:26.947 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:19:26.947 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:19:26.948 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:19:26.948 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:19:26.949 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-01-25T09:19:26.949 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-25T09:19:26.997 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-25T09:19:27.056 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:19:27.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:19:27.057 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-25T09:19:27.072 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:27.072 INFO:tasks.ceph:role: osd.6 2023-01-25T09:19:27.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2023-01-25T09:19:27.073 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T09:19:27.613 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:19:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:19:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:19:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 2023-01-25T09:19:27.614 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:19:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:19:27.615 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:19:27.615 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:19:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:19:27.615 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:19:27.617 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-01-25T09:19:27.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-25T09:19:27.671 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-25T09:19:27.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:19:27.683 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:19:27.684 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-25T09:19:27.742 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:19:27.742 INFO:tasks.ceph:role: osd.7 2023-01-25T09:19:27.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2023-01-25T09:19:27.743 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T09:19:28.244 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:19:28.244 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:19:28.245 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:19:28.245 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 2023-01-25T09:19:28.245 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:19:28.245 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:19:28.246 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:19:28.246 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:19:28.246 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:19:28.246 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:19:28.247 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-01-25T09:19:28.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-25T09:19:28.305 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-25T09:19:28.318 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:19:28.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:19:28.319 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:28.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:28.391+0000 7fd3c6adb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-25T09:19:28.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:28.391+0000 7fd3c6adb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-25T09:19:28.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:28.391+0000 7fd3c6adb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:19:28.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:28.391+0000 7fd3c6adb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:19:28.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:28.391+0000 7fd3c6adb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:19:28.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:28.399+0000 7fd3c6adb640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-25T09:19:29.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:29.219+0000 7fd3c6adb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:30.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:29.999+0000 7fd3c6adb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:30.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:30.787+0000 7fd3c6adb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:31.654 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-25T09:19:31.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:31.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:31.707+0000 7fcd00cd2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-25T09:19:31.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:31.707+0000 7fcd00cd2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-25T09:19:31.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:31.707+0000 7fcd00cd2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:19:31.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:31.707+0000 7fcd00cd2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:19:31.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:31.707+0000 7fcd00cd2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:19:31.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:31.707+0000 7fcd00cd2640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-25T09:19:32.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:32.267+0000 7fcd00cd2640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:33.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:33.055+0000 7fcd00cd2640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:33.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:33.855+0000 7fcd00cd2640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:34.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-25T09:19:34.736 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:34.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:34.823+0000 7fcbcb997640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-25T09:19:34.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:34.823+0000 7fcbcb997640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-25T09:19:34.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:34.823+0000 7fcbcb997640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:19:34.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:34.823+0000 7fcbcb997640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:19:34.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:34.823+0000 7fcbcb997640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:19:34.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:34.823+0000 7fcbcb997640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-01-25T09:19:35.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:35.379+0000 7fcbcb997640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:36.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:36.159+0000 7fcbcb997640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:36.955+0000 7fcbcb997640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:37.812 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-25T09:19:37.830 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:37.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:37.867+0000 7f175e920640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-25T09:19:37.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:37.867+0000 7f175e920640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-25T09:19:37.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:37.867+0000 7f175e920640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:19:37.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:37.867+0000 7f175e920640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:19:37.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:37.867+0000 7f175e920640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:19:37.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:37.867+0000 7f175e920640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-01-25T09:19:38.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:38.435+0000 7f175e920640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:39.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:39.215+0000 7f175e920640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:40.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:40.003+0000 7f175e920640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:19:40.852 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-25T09:19:40.911 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-25T09:19:40.911 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:40.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-25T09:19:40.929 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:40.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-25T09:19:40.985 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:40.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-25T09:19:40.999 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:41.000 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-25T09:19:41.010 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:41.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-25T09:19:41.025 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:41.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-25T09:19:41.041 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:41.041 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-25T09:19:41.051 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:41.051 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-25T09:19:41.109 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:41.110 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-25T09:19:41.121 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:41.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-25T09:19:41.132 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:41.133 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-25T09:19:41.140 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:41.140 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-25T09:19:41.180 INFO:tasks.ceph:Adding keys to all mons... 2023-01-25T09:19:41.181 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T09:19:41.183 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T09:19:41.195 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2023-01-25T09:19:41.195 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAO9NBjXj4lFRAAzdMUh9o3GcaFXiKapjVW7w== 2023-01-25T09:19:41.196 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2023-01-25T09:19:41.196 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAR9NBjGSe1CRAA5BDTcbVs+izrWcfVELjETA== 2023-01-25T09:19:41.196 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2023-01-25T09:19:41.196 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAU9NBj8biBHBAAZDAdSokVU/UkGVrueJd6cg== 2023-01-25T09:19:41.196 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2023-01-25T09:19:41.197 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAX9NBjxO7dIhAAoKsZxHJ9CpK/M5ycwa3E1A== 2023-01-25T09:19:41.197 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2023-01-25T09:19:41.197 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAa9NBjRVW6JRAAJcG7MhUWP9ciPIcgB9eqMA== 2023-01-25T09:19:41.197 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2023-01-25T09:19:41.197 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAO9NBj3umFGBAACXi7Y1CjPWSEbVBlLdsk+g== 2023-01-25T09:19:41.198 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2023-01-25T09:19:41.198 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAg9NBj5fZxFxAADOZPsq86xVBCZkSiNTONpw== 2023-01-25T09:19:41.198 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2023-01-25T09:19:41.198 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAj9NBjNYVKKhAAi/yUxSiAEe1aGkKBjjrlNg== 2023-01-25T09:19:41.198 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2023-01-25T09:19:41.199 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAm9NBjqJAwMRAA7mTog/7Cpwfp5inij0ua0g== 2023-01-25T09:19:41.199 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2023-01-25T09:19:41.199 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAp9NBj3//ZMxAAS1FjbNpyCkbtiBq5d9pMqw== 2023-01-25T09:19:41.199 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2023-01-25T09:19:41.199 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAO9NBjbW4xHBAAt9G8gncZnvcB7SojZSMOZg== 2023-01-25T09:19:41.200 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2023-01-25T09:19:41.200 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAO9NBjSxq0HxAAycgq3cegiBblPB6Kq/fsRA== 2023-01-25T09:19:41.201 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2023-01-25T09:19:41.201 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAO9NBjXj4lFRAAzdMUh9o3GcaFXiKapjVW7w== 2023-01-25T09:19:41.202 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2023-01-25T09:19:41.202 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAR9NBjGSe1CRAA5BDTcbVs+izrWcfVELjETA== 2023-01-25T09:19:41.202 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2023-01-25T09:19:41.202 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAU9NBj8biBHBAAZDAdSokVU/UkGVrueJd6cg== 2023-01-25T09:19:41.203 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2023-01-25T09:19:41.203 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAX9NBjxO7dIhAAoKsZxHJ9CpK/M5ycwa3E1A== 2023-01-25T09:19:41.203 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2023-01-25T09:19:41.203 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAa9NBjRVW6JRAAJcG7MhUWP9ciPIcgB9eqMA== 2023-01-25T09:19:41.203 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2023-01-25T09:19:41.204 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAO9NBj3umFGBAACXi7Y1CjPWSEbVBlLdsk+g== 2023-01-25T09:19:41.204 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2023-01-25T09:19:41.204 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAg9NBj5fZxFxAADOZPsq86xVBCZkSiNTONpw== 2023-01-25T09:19:41.204 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2023-01-25T09:19:41.204 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAj9NBjNYVKKhAAi/yUxSiAEe1aGkKBjjrlNg== 2023-01-25T09:19:41.205 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2023-01-25T09:19:41.205 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAm9NBjqJAwMRAA7mTog/7Cpwfp5inij0ua0g== 2023-01-25T09:19:41.205 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2023-01-25T09:19:41.205 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAp9NBj3//ZMxAAS1FjbNpyCkbtiBq5d9pMqw== 2023-01-25T09:19:41.205 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2023-01-25T09:19:41.206 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAO9NBjbW4xHBAAt9G8gncZnvcB7SojZSMOZg== 2023-01-25T09:19:41.206 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2023-01-25T09:19:41.206 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAO9NBjSxq0HxAAycgq3cegiBblPB6Kq/fsRA== 2023-01-25T09:19:41.206 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:19:41.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:19:41.291 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.294 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.344 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.346 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.395 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.398 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.450 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.497 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:19:41.500 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:19:41.547 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.549 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.637 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.639 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.690 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.738 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:19:41.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:19:41.786 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:19:41.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:19:41.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:19:41.889 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-25T09:19:41.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-25T09:19:41.905 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:19:41.963 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-25T09:19:41.976 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-25T09:19:41.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:19:42.048 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-25T09:19:42.061 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-25T09:19:42.077 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:19:42.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-25T09:19:42.150 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:42.152 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:19:42.200 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-25T09:19:42.201 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-25T09:19:42.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-25T09:19:42.204 INFO:tasks.ceph.mon.a:Started 2023-01-25T09:19:42.204 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-25T09:19:42.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-25T09:19:42.207 INFO:tasks.ceph.mon.c:Started 2023-01-25T09:19:42.207 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-25T09:19:42.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-25T09:19:42.210 INFO:tasks.ceph.mon.b:Started 2023-01-25T09:19:42.210 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-25T09:19:42.211 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-25T09:19:42.211 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-25T09:19:42.214 INFO:tasks.ceph.mgr.y:Started 2023-01-25T09:19:42.214 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-25T09:19:42.215 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-25T09:19:42.217 INFO:tasks.ceph.mgr.x:Started 2023-01-25T09:19:42.217 INFO:tasks.ceph:Setting crush tunables to default 2023-01-25T09:19:42.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2023-01-25T09:19:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2023-01-25T09:19:48.553 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-25T09:19:48.553 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:48.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-25T09:19:48.567 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:48.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-25T09:19:48.580 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:48.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-25T09:19:48.593 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-01-25T09:19:48.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-25T09:19:48.603 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:48.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-25T09:19:48.619 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:48.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-25T09:19:48.629 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:48.622+0000 7ffb17b842c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T09:19:48.633 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:48.623+0000 7f675af872c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T09:19:48.640 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:48.640 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-25T09:19:48.697 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-01-25T09:19:48.697 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-25T09:19:48.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 53fdbafb-c0a6-4c57-98cf-7cd05147b38a 0 2023-01-25T09:19:48.918 INFO:teuthology.orchestra.run.smithi106.stdout:0 2023-01-25T09:19:48.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 947d4652-4756-4b6b-812f-c9efc443df03 1 2023-01-25T09:19:49.225 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:49.218+0000 7ffb17b842c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T09:19:49.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-01-25T09:19:49.242+0000 7f563affd700 0 --2- 172.21.15.106:0/1183266936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f563c0b1820 0x7f563c13b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-01-25T09:19:49.282 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:49.274+0000 7ffb17b842c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T09:19:49.288 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:49.279+0000 7f675af872c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T09:19:49.346 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:49.335+0000 7f675af872c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T09:19:49.348 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-01-25T09:19:49.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 870a632b-a4a8-4b5b-bc96-d48d8144e753 2 2023-01-25T09:19:49.396 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:49.390+0000 7ffb17b842c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:19:49.465 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:49.455+0000 7f675af872c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:19:49.564 INFO:teuthology.orchestra.run.smithi106.stdout:2 2023-01-25T09:19:49.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 6da8a837-126b-443e-bcdd-0b4ea6385cac 3 2023-01-25T09:19:49.619 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:49.614+0000 7ffb17b842c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T09:19:49.668 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:49.662+0000 7ffb17b842c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T09:19:49.711 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:49.703+0000 7f675af872c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T09:19:49.764 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:49.755+0000 7f675af872c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T09:19:49.786 INFO:teuthology.orchestra.run.smithi106.stdout:3 2023-01-25T09:19:49.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new a0bbe4b6-09df-418c-8b28-b215ca749006 4 2023-01-25T09:19:49.841 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:49.834+0000 7ffb17b842c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T09:19:49.903 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:49.898+0000 7ffb17b842c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T09:19:49.955 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:49.947+0000 7f675af872c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T09:19:49.965 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:49.958+0000 7ffb17b842c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T09:19:50.004 INFO:teuthology.orchestra.run.smithi106.stdout:4 2023-01-25T09:19:50.018 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 1435c1b5-9a3b-472e-8a3d-26a4ff408edd 5 2023-01-25T09:19:50.023 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:50.015+0000 7f675af872c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T09:19:50.092 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:50.083+0000 7f675af872c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T09:19:50.220 INFO:teuthology.orchestra.run.smithi106.stdout:5 2023-01-25T09:19:50.235 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new a52c4e29-2070-4066-a8c1-f8f7b597b456 6 2023-01-25T09:19:50.351 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:50.346+0000 7ffb17b842c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T09:19:50.455 INFO:teuthology.orchestra.run.smithi106.stdout:6 2023-01-25T09:19:50.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new e5f4dc2d-cda8-4c86-a6e8-0727404f5d3d 7 2023-01-25T09:19:50.495 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:50.490+0000 7ffb17b842c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T09:19:50.515 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:50.507+0000 7f675af872c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T09:19:50.641 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:50.631+0000 7f675af872c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T09:19:50.673 INFO:teuthology.orchestra.run.smithi106.stdout:7 2023-01-25T09:19:50.688 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-25T09:19:50.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-25T09:19:50.691 INFO:tasks.ceph.osd.0:Started 2023-01-25T09:19:50.691 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-25T09:19:50.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-25T09:19:50.694 INFO:tasks.ceph.osd.1:Started 2023-01-25T09:19:50.694 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-25T09:19:50.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-25T09:19:50.697 INFO:tasks.ceph.osd.2:Started 2023-01-25T09:19:50.697 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-25T09:19:50.697 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-25T09:19:50.700 INFO:tasks.ceph.osd.3:Started 2023-01-25T09:19:50.700 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-25T09:19:50.701 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-25T09:19:50.731 INFO:tasks.ceph.osd.4:Started 2023-01-25T09:19:50.732 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-25T09:19:50.732 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-25T09:19:50.735 INFO:tasks.ceph.osd.5:Started 2023-01-25T09:19:50.735 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-25T09:19:50.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-25T09:19:50.737 INFO:tasks.ceph.osd.6:Started 2023-01-25T09:19:50.738 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-25T09:19:50.738 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-25T09:19:50.740 INFO:tasks.ceph.osd.7:Started 2023-01-25T09:19:50.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:19:50.830 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:50.826+0000 7ffb17b842c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T09:19:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:19:50.938 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1","created":"2023-01-25T09:19:48.383904+0000","modified":"2023-01-25T09:19:50.662801+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T09:19:50.662801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"53fdbafb-c0a6-4c57-98cf-7cd05147b38a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"947d4652-4756-4b6b-812f-c9efc443df03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"870a632b-a4a8-4b5b-bc96-d48d8144e753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6da8a837-126b-443e-bcdd-0b4ea6385cac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a0bbe4b6-09df-418c-8b28-b215ca749006","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1435c1b5-9a3b-472e-8a3d-26a4ff408edd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a52c4e29-2070-4066-a8c1-f8f7b597b456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5f4dc2d-cda8-4c86-a6e8-0727404f5d3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:19:50.951 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-25T09:19:50.952 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-25T09:19:51.004 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:50.998+0000 7ffb17b842c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:19:51.008 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:50.999+0000 7f675af872c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T09:19:51.075 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:51.070+0000 7ffb17b842c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T09:19:51.091 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-01-25T09:19:51.083+0000 7f5ce4b97640 -1 Falling back to public interface 2023-01-25T09:19:51.104 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-01-25T09:19:51.095+0000 7fed3f42c640 -1 Falling back to public interface 2023-01-25T09:19:51.104 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-01-25T09:19:51.095+0000 7f304d73d640 -1 Falling back to public interface 2023-01-25T09:19:51.112 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-01-25T09:19:51.106+0000 7f75192b8640 -1 Falling back to public interface 2023-01-25T09:19:51.128 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:51.122+0000 7ffb17b842c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T09:19:51.135 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-01-25T09:19:51.130+0000 7f243ff49640 -1 Falling back to public interface 2023-01-25T09:19:51.182 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:51.171+0000 7f675af872c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:19:51.249 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:51.239+0000 7f675af872c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T09:19:51.304 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:51.295+0000 7f675af872c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T09:19:51.360 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-01-25T09:19:51.351+0000 7ff2355ce640 -1 Falling back to public interface 2023-01-25T09:19:51.364 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-01-25T09:19:51.358+0000 7f3f9aa93640 -1 Falling back to public interface 2023-01-25T09:19:51.556 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-01-25T09:19:51.550+0000 7f500783e640 -1 Falling back to public interface 2023-01-25T09:19:51.757 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T09:19:51.941 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:51.934+0000 7ffb17b842c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T09:19:51.954 INFO:teuthology.misc.health.smithi019.stdout: 2023-01-25T09:19:51.954 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1","created":"2023-01-25T09:19:48.383904+0000","modified":"2023-01-25T09:19:50.662801+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T09:19:50.662801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"53fdbafb-c0a6-4c57-98cf-7cd05147b38a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"947d4652-4756-4b6b-812f-c9efc443df03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"870a632b-a4a8-4b5b-bc96-d48d8144e753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6da8a837-126b-443e-bcdd-0b4ea6385cac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a0bbe4b6-09df-418c-8b28-b215ca749006","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1435c1b5-9a3b-472e-8a3d-26a4ff408edd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a52c4e29-2070-4066-a8c1-f8f7b597b456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5f4dc2d-cda8-4c86-a6e8-0727404f5d3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:19:51.966 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-25T09:19:52.004 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:51.998+0000 7ffb17b842c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T09:19:52.142 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:52.131+0000 7f675af872c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T09:19:52.192 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:52.186+0000 7ffb17b842c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T09:19:52.207 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:52.199+0000 7f675af872c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T09:19:52.255 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:52.250+0000 7ffb17b842c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T09:19:52.326 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:52.318+0000 7ffb17b842c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T09:19:52.388 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:52.379+0000 7f675af872c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T09:19:52.453 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:52.443+0000 7f675af872c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T09:19:52.499 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:52.494+0000 7ffb17b842c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T09:19:52.528 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:52.519+0000 7f675af872c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T09:19:52.571 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:52.566+0000 7ffb17b842c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T09:19:52.707 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:52.699+0000 7f675af872c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T09:19:52.781 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:52.771+0000 7f675af872c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T09:19:53.354 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:53.350+0000 7ffb17b842c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T09:19:53.625 INFO:tasks.ceph.mgr.y.smithi019.stderr:2023-01-25T09:19:53.615+0000 7f675af872c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T09:19:54.275 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-01-25T09:19:54.267+0000 7f304d73d640 -1 osd.1 0 log_to_monitors true 2023-01-25T09:19:54.403 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:54.398+0000 7ffaff115700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-25T09:19:54.408 INFO:tasks.ceph.mgr.x.smithi106.stderr:2023-01-25T09:19:54.402+0000 7ffaff115700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-25T09:19:54.706 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-01-25T09:19:54.702+0000 7f75192b8640 -1 osd.5 0 log_to_monitors true 2023-01-25T09:19:54.926 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-01-25T09:19:54.918+0000 7f3f9aa93640 -1 osd.4 0 log_to_monitors true 2023-01-25T09:19:54.952 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-01-25T09:19:54.943+0000 7f5ce4b97640 -1 osd.0 0 log_to_monitors true 2023-01-25T09:19:55.001 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-01-25T09:19:54.991+0000 7fed3f42c640 -1 osd.3 0 log_to_monitors true 2023-01-25T09:19:55.029 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-01-25T09:19:55.022+0000 7f243ff49640 -1 osd.6 0 log_to_monitors true 2023-01-25T09:19:55.274 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-01-25T09:19:55.263+0000 7ff2355ce640 -1 osd.2 0 log_to_monitors true 2023-01-25T09:19:55.435 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-01-25T09:19:55.430+0000 7f500783e640 -1 osd.7 0 log_to_monitors true 2023-01-25T09:19:55.518 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-01-25T09:19:55.507+0000 7f304957a700 -1 osd.1 0 waiting for initial osdmap 2023-01-25T09:19:55.529 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-01-25T09:19:55.519+0000 7f3045031700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:19:56.520 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-01-25T09:19:56.511+0000 7ff23140b700 -1 osd.2 0 waiting for initial osdmap 2023-01-25T09:19:56.521 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-01-25T09:19:56.514+0000 7f243c70d700 -1 osd.6 0 waiting for initial osdmap 2023-01-25T09:19:56.521 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-01-25T09:19:56.514+0000 7f500367b700 -1 osd.7 0 waiting for initial osdmap 2023-01-25T09:19:56.521 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-01-25T09:19:56.514+0000 7f75150f5700 -1 osd.5 0 waiting for initial osdmap 2023-01-25T09:19:56.522 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-01-25T09:19:56.514+0000 7f3f968d0700 -1 osd.4 0 waiting for initial osdmap 2023-01-25T09:19:56.526 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-01-25T09:19:56.519+0000 7fed3bbf0700 -1 osd.3 0 waiting for initial osdmap 2023-01-25T09:19:56.527 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-01-25T09:19:56.519+0000 7f5ce09d4700 -1 osd.0 0 waiting for initial osdmap 2023-01-25T09:19:56.533 INFO:tasks.ceph.osd.4.smithi106.stderr:2023-01-25T09:19:56.526+0000 7f3f92387700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:19:56.533 INFO:tasks.ceph.osd.7.smithi106.stderr:2023-01-25T09:19:56.526+0000 7f4fff132700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:19:56.534 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-01-25T09:19:56.527+0000 7ff22cec2700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:19:56.535 INFO:tasks.ceph.osd.6.smithi106.stderr:2023-01-25T09:19:56.530+0000 7f243783d700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:19:56.535 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-01-25T09:19:56.527+0000 7f5cdc48b700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:19:56.535 INFO:tasks.ceph.osd.5.smithi106.stderr:2023-01-25T09:19:56.530+0000 7f7510bac700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:19:56.536 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-01-25T09:19:56.527+0000 7fed36d20700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:19:58.771 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T09:19:59.072 INFO:teuthology.misc.health.smithi019.stdout: 2023-01-25T09:19:59.072 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":15,"fsid":"ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1","created":"2023-01-25T09:19:48.383904+0000","modified":"2023-01-25T09:19:58.537430+0000","last_up_change":"2023-01-25T09:19:57.533024+0000","last_in_change":"2023-01-25T09:19:50.662801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"53fdbafb-c0a6-4c57-98cf-7cd05147b38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":27870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6801","nonce":27870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6803","nonce":27870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":27870}]},"public_addr":"172.21.15.19:6800/27870","cluster_addr":"172.21.15.19:6801/27870","heartbeat_back_addr":"172.21.15.19:6803/27870","heartbeat_front_addr":"172.21.15.19:6802/27870","state":["exists","up"]},{"osd":1,"uuid":"947d4652-4756-4b6b-812f-c9efc443df03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":27874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":27874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":27874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":27874}]},"public_addr":"172.21.15.19:6804/27874","cluster_addr":"172.21.15.19:6806/27874","heartbeat_back_addr":"172.21.15.19:6810/27874","heartbeat_front_addr":"172.21.15.19:6808/27874","state":["exists","up"]},{"osd":2,"uuid":"870a632b-a4a8-4b5b-bc96-d48d8144e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":27876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":27876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6815","nonce":27876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":27876}]},"public_addr":"172.21.15.19:6812/27876","cluster_addr":"172.21.15.19:6813/27876","heartbeat_back_addr":"172.21.15.19:6815/27876","heartbeat_front_addr":"172.21.15.19:6814/27876","state":["exists","up"]},{"osd":3,"uuid":"6da8a837-126b-443e-bcdd-0b4ea6385cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":27877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6807","nonce":27877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6811","nonce":27877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":27877}]},"public_addr":"172.21.15.19:6805/27877","cluster_addr":"172.21.15.19:6807/27877","heartbeat_back_addr":"172.21.15.19:6811/27877","heartbeat_front_addr":"172.21.15.19:6809/27877","state":["exists","up"]},{"osd":4,"uuid":"a0bbe4b6-09df-418c-8b28-b215ca749006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":28008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":28008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6811","nonce":28008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":28008}]},"public_addr":"172.21.15.106:6808/28008","cluster_addr":"172.21.15.106:6809/28008","heartbeat_back_addr":"172.21.15.106:6811/28008","heartbeat_front_addr":"172.21.15.106:6810/28008","state":["exists","up"]},{"osd":5,"uuid":"1435c1b5-9a3b-472e-8a3d-26a4ff408edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":28005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":28005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6803","nonce":28005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":28005}]},"public_addr":"172.21.15.106:6800/28005","cluster_addr":"172.21.15.106:6801/28005","heartbeat_back_addr":"172.21.15.106:6803/28005","heartbeat_front_addr":"172.21.15.106:6802/28005","state":["exists","up"]},{"osd":6,"uuid":"a52c4e29-2070-4066-a8c1-f8f7b597b456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":28006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":28006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":28006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":28006}]},"public_addr":"172.21.15.106:6804/28006","cluster_addr":"172.21.15.106:6805/28006","heartbeat_back_addr":"172.21.15.106:6807/28006","heartbeat_front_addr":"172.21.15.106:6806/28006","state":["exists","up"]},{"osd":7,"uuid":"e5f4dc2d-cda8-4c86-a6e8-0727404f5d3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":28007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":28007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6815","nonce":28007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":28007}]},"public_addr":"172.21.15.106:6812/28007","cluster_addr":"172.21.15.106:6813/28007","heartbeat_back_addr":"172.21.15.106:6815/28007","heartbeat_front_addr":"172.21.15.106:6814/28007","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.996115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.225982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.230767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.000472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.974441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.657933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.046345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.440117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:19:59.086 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-25T09:19:59.086 INFO:tasks.ceph:Creating RBD pool 2023-01-25T09:19:59.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-25T09:19:59.564 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'rbd' created 2023-01-25T09:19:59.577 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-25T09:20:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-25T09:20:00.594 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-25T09:20:00.595 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-25T09:20:00.596 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-25T09:20:00.596 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-25T09:20:00.597 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-25T09:20:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:20:00.965 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":4,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27704}]},"active_addr":"172.21.15.106:6816/27704","active_change":"2023-01-25T09:19:53.373775+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4098,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3566441097}]},{"addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":239496211}]},{"addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3261142832}]}]}} 2023-01-25T09:20:00.972 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-25T09:20:00.973 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-25T09:20:00.973 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:20:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:20:01.271 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1","created":"2023-01-25T09:19:48.383904+0000","modified":"2023-01-25T09:20:00.549810+0000","last_up_change":"2023-01-25T09:19:57.533024+0000","last_in_change":"2023-01-25T09:19:50.662801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-25T09:19:59.432482+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-25T09:19:59.469591+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"53fdbafb-c0a6-4c57-98cf-7cd05147b38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":27870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6801","nonce":27870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6803","nonce":27870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":27870}]},"public_addr":"172.21.15.19:6800/27870","cluster_addr":"172.21.15.19:6801/27870","heartbeat_back_addr":"172.21.15.19:6803/27870","heartbeat_front_addr":"172.21.15.19:6802/27870","state":["exists","up"]},{"osd":1,"uuid":"947d4652-4756-4b6b-812f-c9efc443df03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":27874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":27874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":27874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":27874}]},"public_addr":"172.21.15.19:6804/27874","cluster_addr":"172.21.15.19:6806/27874","heartbeat_back_addr":"172.21.15.19:6810/27874","heartbeat_front_addr":"172.21.15.19:6808/27874","state":["exists","up"]},{"osd":2,"uuid":"870a632b-a4a8-4b5b-bc96-d48d8144e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":27876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":27876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6815","nonce":27876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":27876}]},"public_addr":"172.21.15.19:6812/27876","cluster_addr":"172.21.15.19:6813/27876","heartbeat_back_addr":"172.21.15.19:6815/27876","heartbeat_front_addr":"172.21.15.19:6814/27876","state":["exists","up"]},{"osd":3,"uuid":"6da8a837-126b-443e-bcdd-0b4ea6385cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":27877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6807","nonce":27877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6811","nonce":27877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":27877}]},"public_addr":"172.21.15.19:6805/27877","cluster_addr":"172.21.15.19:6807/27877","heartbeat_back_addr":"172.21.15.19:6811/27877","heartbeat_front_addr":"172.21.15.19:6809/27877","state":["exists","up"]},{"osd":4,"uuid":"a0bbe4b6-09df-418c-8b28-b215ca749006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":28008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":28008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6811","nonce":28008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":28008}]},"public_addr":"172.21.15.106:6808/28008","cluster_addr":"172.21.15.106:6809/28008","heartbeat_back_addr":"172.21.15.106:6811/28008","heartbeat_front_addr":"172.21.15.106:6810/28008","state":["exists","up"]},{"osd":5,"uuid":"1435c1b5-9a3b-472e-8a3d-26a4ff408edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":28005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":28005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6803","nonce":28005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":28005}]},"public_addr":"172.21.15.106:6800/28005","cluster_addr":"172.21.15.106:6801/28005","heartbeat_back_addr":"172.21.15.106:6803/28005","heartbeat_front_addr":"172.21.15.106:6802/28005","state":["exists","up"]},{"osd":6,"uuid":"a52c4e29-2070-4066-a8c1-f8f7b597b456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":28006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":28006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":28006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":28006}]},"public_addr":"172.21.15.106:6804/28006","cluster_addr":"172.21.15.106:6805/28006","heartbeat_back_addr":"172.21.15.106:6807/28006","heartbeat_front_addr":"172.21.15.106:6806/28006","state":["exists","up"]},{"osd":7,"uuid":"e5f4dc2d-cda8-4c86-a6e8-0727404f5d3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":28007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":28007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6815","nonce":28007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":28007}]},"public_addr":"172.21.15.106:6812/28007","cluster_addr":"172.21.15.106:6813/28007","heartbeat_back_addr":"172.21.15.106:6815/28007","heartbeat_front_addr":"172.21.15.106:6814/28007","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.996115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.225982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.230767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.000472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.974441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.657933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.046345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.440117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:20:01.285 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-25T09:20:01.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:20:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:20:01.592 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1","created":"2023-01-25T09:19:48.383904+0000","modified":"2023-01-25T09:20:01.561393+0000","last_up_change":"2023-01-25T09:19:57.533024+0000","last_in_change":"2023-01-25T09:19:50.662801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-25T09:19:59.432482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-25T09:19:59.469591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"53fdbafb-c0a6-4c57-98cf-7cd05147b38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":27870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6801","nonce":27870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6803","nonce":27870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":27870}]},"public_addr":"172.21.15.19:6800/27870","cluster_addr":"172.21.15.19:6801/27870","heartbeat_back_addr":"172.21.15.19:6803/27870","heartbeat_front_addr":"172.21.15.19:6802/27870","state":["exists","up"]},{"osd":1,"uuid":"947d4652-4756-4b6b-812f-c9efc443df03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":27874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":27874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":27874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":27874}]},"public_addr":"172.21.15.19:6804/27874","cluster_addr":"172.21.15.19:6806/27874","heartbeat_back_addr":"172.21.15.19:6810/27874","heartbeat_front_addr":"172.21.15.19:6808/27874","state":["exists","up"]},{"osd":2,"uuid":"870a632b-a4a8-4b5b-bc96-d48d8144e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":27876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6813","nonce":27876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6815","nonce":27876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":27876}]},"public_addr":"172.21.15.19:6812/27876","cluster_addr":"172.21.15.19:6813/27876","heartbeat_back_addr":"172.21.15.19:6815/27876","heartbeat_front_addr":"172.21.15.19:6814/27876","state":["exists","up"]},{"osd":3,"uuid":"6da8a837-126b-443e-bcdd-0b4ea6385cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":27877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6807","nonce":27877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6811","nonce":27877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":27877}]},"public_addr":"172.21.15.19:6805/27877","cluster_addr":"172.21.15.19:6807/27877","heartbeat_back_addr":"172.21.15.19:6811/27877","heartbeat_front_addr":"172.21.15.19:6809/27877","state":["exists","up"]},{"osd":4,"uuid":"a0bbe4b6-09df-418c-8b28-b215ca749006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":28008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":28008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6811","nonce":28008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":28008}]},"public_addr":"172.21.15.106:6808/28008","cluster_addr":"172.21.15.106:6809/28008","heartbeat_back_addr":"172.21.15.106:6811/28008","heartbeat_front_addr":"172.21.15.106:6810/28008","state":["exists","up"]},{"osd":5,"uuid":"1435c1b5-9a3b-472e-8a3d-26a4ff408edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":28005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":28005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6803","nonce":28005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":28005}]},"public_addr":"172.21.15.106:6800/28005","cluster_addr":"172.21.15.106:6801/28005","heartbeat_back_addr":"172.21.15.106:6803/28005","heartbeat_front_addr":"172.21.15.106:6802/28005","state":["exists","up"]},{"osd":6,"uuid":"a52c4e29-2070-4066-a8c1-f8f7b597b456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":28006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":28006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":28006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":28006}]},"public_addr":"172.21.15.106:6804/28006","cluster_addr":"172.21.15.106:6805/28006","heartbeat_back_addr":"172.21.15.106:6807/28006","heartbeat_front_addr":"172.21.15.106:6806/28006","state":["exists","up"]},{"osd":7,"uuid":"e5f4dc2d-cda8-4c86-a6e8-0727404f5d3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":28007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":28007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6815","nonce":28007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":28007}]},"public_addr":"172.21.15.106:6812/28007","cluster_addr":"172.21.15.106:6813/28007","heartbeat_back_addr":"172.21.15.106:6815/28007","heartbeat_front_addr":"172.21.15.106:6814/28007","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.996115+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.225982+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.230767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.000472+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.974441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:55.657933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.046345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:19:56.440117+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:20:01.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-25T09:20:01.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-25T09:20:01.608 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-25T09:20:01.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-25T09:20:01.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-25T09:20:01.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-25T09:20:01.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-25T09:20:01.612 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-25T09:20:01.835 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2023-01-25T09:20:01.836 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T09:20:01.837 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:01.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T09:20:01.838 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:01.839 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:01.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T09:20:01.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T09:20:01.842 INFO:teuthology.orchestra.run.smithi019.stdout:60129542148 2023-01-25T09:20:01.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T09:20:01.848 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:01.848 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T09:20:01.849 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:01.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T09:20:01.854 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:01.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T09:20:02.323 INFO:teuthology.orchestra.run.smithi019.stdout:55834574850 2023-01-25T09:20:02.324 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:02.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.1 2023-01-25T09:20:02.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.6 2023-01-25T09:20:02.357 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:02.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.7 2023-01-25T09:20:02.374 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:02.380 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:02.384 INFO:teuthology.orchestra.run.smithi019.stdout:60129542145 2023-01-25T09:20:02.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.4 2023-01-25T09:20:02.394 INFO:teuthology.orchestra.run.smithi019.stdout:60129542145 2023-01-25T09:20:02.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2023-01-25T09:20:02.402 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:02.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.2 2023-01-25T09:20:02.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.5 2023-01-25T09:20:02.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.0 2023-01-25T09:20:03.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T09:20:03.348 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T09:20:03.372 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T09:20:03.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T09:20:03.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T09:20:03.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T09:20:03.411 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T09:20:03.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T09:20:03.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-01-25T09:20:03.702+0000 7f82b9314700 0 --2- 172.21.15.19:0/1095459732 >> v2:172.21.15.19:3300/0 conn(0x7f82b40712e0 0x7f82b4137f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-01-25T09:20:03.806 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:03.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.6 2023-01-25T09:20:03.864 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:03.876 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:03.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.7 2023-01-25T09:20:03.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.4 2023-01-25T09:20:03.890 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:03.894 INFO:teuthology.orchestra.run.smithi019.stdout:60129542145 2023-01-25T09:20:03.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.0 2023-01-25T09:20:03.910 INFO:teuthology.orchestra.run.smithi019.stdout:60129542145 2023-01-25T09:20:03.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.5 2023-01-25T09:20:03.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.2 2023-01-25T09:20:03.930 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:03.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2023-01-25T09:20:04.002 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2023-01-25T09:20:04.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2023-01-25T09:20:04.014 DEBUG:teuthology.parallel:result is None 2023-01-25T09:20:04.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T09:20:04.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T09:20:04.890 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T09:20:04.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T09:20:04.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T09:20:04.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T09:20:04.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T09:20:05.219 INFO:teuthology.orchestra.run.smithi019.stdout:60129542148 2023-01-25T09:20:05.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2023-01-25T09:20:05.233 DEBUG:teuthology.parallel:result is None 2023-01-25T09:20:05.306 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:05.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.6 2023-01-25T09:20:05.324 DEBUG:teuthology.parallel:result is None 2023-01-25T09:20:05.346 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:05.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.7 2023-01-25T09:20:05.363 DEBUG:teuthology.parallel:result is None 2023-01-25T09:20:05.379 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:05.388 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:05.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.2 2023-01-25T09:20:05.392 INFO:teuthology.orchestra.run.smithi019.stdout:60129542147 2023-01-25T09:20:05.392 DEBUG:teuthology.parallel:result is None 2023-01-25T09:20:05.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2023-01-25T09:20:05.403 DEBUG:teuthology.parallel:result is None 2023-01-25T09:20:05.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.0 2023-01-25T09:20:05.405 DEBUG:teuthology.parallel:result is None 2023-01-25T09:20:05.418 INFO:teuthology.orchestra.run.smithi019.stdout:60129542146 2023-01-25T09:20:05.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.5 2023-01-25T09:20:05.431 DEBUG:teuthology.parallel:result is None 2023-01-25T09:20:05.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T09:20:05.431 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:20:05.720 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:20:05.722 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-01-25T09:20:05.734 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T09:20:05.389544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":42716,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":40000,"kb_avail":754932004,"statfs":{"total":773094113280,"available":773050372096,"internally_reserved":0,"allocated":2260992,"data_stored":1395882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40960000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":47,"num_write":81,"num_write_kb":1567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000730"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.805191+0000","last_change":"2023-01-25T09:20:00.581551+0000","last_active":"2023-01-25T09:20:01.805191+0000","last_peered":"2023-01-25T09:20:01.805191+0000","last_clean":"2023-01-25T09:20:01.805191+0000","last_became_active":"2023-01-25T09:20:00.581080+0000","last_became_peered":"2023-01-25T09:20:00.581080+0000","last_unstale":"2023-01-25T09:20:01.805191+0000","last_undegraded":"2023-01-25T09:20:01.805191+0000","last_fullsized":"2023-01-25T09:20:01.805191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:05.252876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.805119+0000","last_change":"2023-01-25T09:20:00.578486+0000","last_active":"2023-01-25T09:20:01.805119+0000","last_peered":"2023-01-25T09:20:01.805119+0000","last_clean":"2023-01-25T09:20:01.805119+0000","last_became_active":"2023-01-25T09:20:00.578131+0000","last_became_peered":"2023-01-25T09:20:00.578131+0000","last_unstale":"2023-01-25T09:20:01.805119+0000","last_undegraded":"2023-01-25T09:20:01.805119+0000","last_fullsized":"2023-01-25T09:20:01.805119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:13.562173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.579717+0000","last_change":"2023-01-25T09:20:01.290335+0000","last_active":"2023-01-25T09:20:01.579717+0000","last_peered":"2023-01-25T09:20:01.579717+0000","last_clean":"2023-01-25T09:20:01.579717+0000","last_became_active":"2023-01-25T09:20:01.289388+0000","last_became_peered":"2023-01-25T09:20:01.289388+0000","last_unstale":"2023-01-25T09:20:01.579717+0000","last_undegraded":"2023-01-25T09:20:01.579717+0000","last_fullsized":"2023-01-25T09:20:01.579717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:21.458695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.573134+0000","last_change":"2023-01-25T09:20:00.580834+0000","last_active":"2023-01-25T09:20:01.573134+0000","last_peered":"2023-01-25T09:20:01.573134+0000","last_clean":"2023-01-25T09:20:01.573134+0000","last_became_active":"2023-01-25T09:20:00.580323+0000","last_became_peered":"2023-01-25T09:20:00.580323+0000","last_unstale":"2023-01-25T09:20:01.573134+0000","last_undegraded":"2023-01-25T09:20:01.573134+0000","last_fullsized":"2023-01-25T09:20:01.573134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:12.255086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'105","reported_seq":146,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:02.971076+0000","last_change":"2023-01-25T09:20:00.583208+0000","last_active":"2023-01-25T09:20:02.971076+0000","last_peered":"2023-01-25T09:20:02.971076+0000","last_clean":"2023-01-25T09:20:02.971076+0000","last_became_active":"2023-01-25T09:20:00.582552+0000","last_became_peered":"2023-01-25T09:20:00.582552+0000","last_unstale":"2023-01-25T09:20:02.971076+0000","last_undegraded":"2023-01-25T09:20:02.971076+0000","last_fullsized":"2023-01-25T09:20:02.971076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:06.215489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.519839+0000","last_change":"2023-01-25T09:20:00.576611+0000","last_active":"2023-01-25T09:20:01.519839+0000","last_peered":"2023-01-25T09:20:01.519839+0000","last_clean":"2023-01-25T09:20:01.519839+0000","last_became_active":"2023-01-25T09:20:00.575958+0000","last_became_peered":"2023-01-25T09:20:00.575958+0000","last_unstale":"2023-01-25T09:20:01.519839+0000","last_undegraded":"2023-01-25T09:20:01.519839+0000","last_fullsized":"2023-01-25T09:20:01.519839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:19.955308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.774267+0000","last_change":"2023-01-25T09:20:00.582891+0000","last_active":"2023-01-25T09:20:01.774267+0000","last_peered":"2023-01-25T09:20:01.774267+0000","last_clean":"2023-01-25T09:20:01.774267+0000","last_became_active":"2023-01-25T09:20:00.582465+0000","last_became_peered":"2023-01-25T09:20:00.582465+0000","last_unstale":"2023-01-25T09:20:01.774267+0000","last_undegraded":"2023-01-25T09:20:01.774267+0000","last_fullsized":"2023-01-25T09:20:01.774267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:22.832943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.820176+0000","last_change":"2023-01-25T09:20:01.290672+0000","last_active":"2023-01-25T09:20:01.820176+0000","last_peered":"2023-01-25T09:20:01.820176+0000","last_clean":"2023-01-25T09:20:01.820176+0000","last_became_active":"2023-01-25T09:20:01.289735+0000","last_became_peered":"2023-01-25T09:20:01.289735+0000","last_unstale":"2023-01-25T09:20:01.820176+0000","last_undegraded":"2023-01-25T09:20:01.820176+0000","last_fullsized":"2023-01-25T09:20:01.820176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:03.679432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.774199+0000","last_change":"2023-01-25T09:20:00.583794+0000","last_active":"2023-01-25T09:20:01.774199+0000","last_peered":"2023-01-25T09:20:01.774199+0000","last_clean":"2023-01-25T09:20:01.774199+0000","last_became_active":"2023-01-25T09:20:00.583095+0000","last_became_peered":"2023-01-25T09:20:00.583095+0000","last_unstale":"2023-01-25T09:20:01.774199+0000","last_undegraded":"2023-01-25T09:20:01.774199+0000","last_fullsized":"2023-01-25T09:20:01.774199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:08.981177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1150976,"data_stored":1140304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":3,"acting":3,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6248,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365592,"statfs":{"total":96636764160,"available":96630366208,"internally_reserved":0,"allocated":626688,"data_stored":516063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":651.52200000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5744,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366096,"statfs":{"total":96636764160,"available":96630882304,"internally_reserved":0,"allocated":565248,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5412,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366428,"statfs":{"total":96636764160,"available":96631222272,"internally_reserved":0,"allocated":290816,"data_stored":182853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":205328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:20:05.735 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:20:06.018 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:20:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-01-25T09:20:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T09:20:05.389544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":42716,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":40000,"kb_avail":754932004,"statfs":{"total":773094113280,"available":773050372096,"internally_reserved":0,"allocated":2260992,"data_stored":1395882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40960000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":47,"num_write":81,"num_write_kb":1567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000730"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.805191+0000","last_change":"2023-01-25T09:20:00.581551+0000","last_active":"2023-01-25T09:20:01.805191+0000","last_peered":"2023-01-25T09:20:01.805191+0000","last_clean":"2023-01-25T09:20:01.805191+0000","last_became_active":"2023-01-25T09:20:00.581080+0000","last_became_peered":"2023-01-25T09:20:00.581080+0000","last_unstale":"2023-01-25T09:20:01.805191+0000","last_undegraded":"2023-01-25T09:20:01.805191+0000","last_fullsized":"2023-01-25T09:20:01.805191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:05.252876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.805119+0000","last_change":"2023-01-25T09:20:00.578486+0000","last_active":"2023-01-25T09:20:01.805119+0000","last_peered":"2023-01-25T09:20:01.805119+0000","last_clean":"2023-01-25T09:20:01.805119+0000","last_became_active":"2023-01-25T09:20:00.578131+0000","last_became_peered":"2023-01-25T09:20:00.578131+0000","last_unstale":"2023-01-25T09:20:01.805119+0000","last_undegraded":"2023-01-25T09:20:01.805119+0000","last_fullsized":"2023-01-25T09:20:01.805119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:13.562173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.579717+0000","last_change":"2023-01-25T09:20:01.290335+0000","last_active":"2023-01-25T09:20:01.579717+0000","last_peered":"2023-01-25T09:20:01.579717+0000","last_clean":"2023-01-25T09:20:01.579717+0000","last_became_active":"2023-01-25T09:20:01.289388+0000","last_became_peered":"2023-01-25T09:20:01.289388+0000","last_unstale":"2023-01-25T09:20:01.579717+0000","last_undegraded":"2023-01-25T09:20:01.579717+0000","last_fullsized":"2023-01-25T09:20:01.579717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:21.458695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.573134+0000","last_change":"2023-01-25T09:20:00.580834+0000","last_active":"2023-01-25T09:20:01.573134+0000","last_peered":"2023-01-25T09:20:01.573134+0000","last_clean":"2023-01-25T09:20:01.573134+0000","last_became_active":"2023-01-25T09:20:00.580323+0000","last_became_peered":"2023-01-25T09:20:00.580323+0000","last_unstale":"2023-01-25T09:20:01.573134+0000","last_undegraded":"2023-01-25T09:20:01.573134+0000","last_fullsized":"2023-01-25T09:20:01.573134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:12.255086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'105","reported_seq":146,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:02.971076+0000","last_change":"2023-01-25T09:20:00.583208+0000","last_active":"2023-01-25T09:20:02.971076+0000","last_peered":"2023-01-25T09:20:02.971076+0000","last_clean":"2023-01-25T09:20:02.971076+0000","last_became_active":"2023-01-25T09:20:00.582552+0000","last_became_peered":"2023-01-25T09:20:00.582552+0000","last_unstale":"2023-01-25T09:20:02.971076+0000","last_undegraded":"2023-01-25T09:20:02.971076+0000","last_fullsized":"2023-01-25T09:20:02.971076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:06.215489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.519839+0000","last_change":"2023-01-25T09:20:00.576611+0000","last_active":"2023-01-25T09:20:01.519839+0000","last_peered":"2023-01-25T09:20:01.519839+0000","last_clean":"2023-01-25T09:20:01.519839+0000","last_became_active":"2023-01-25T09:20:00.575958+0000","last_became_peered":"2023-01-25T09:20:00.575958+0000","last_unstale":"2023-01-25T09:20:01.519839+0000","last_undegraded":"2023-01-25T09:20:01.519839+0000","last_fullsized":"2023-01-25T09:20:01.519839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:19.955308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.774267+0000","last_change":"2023-01-25T09:20:00.582891+0000","last_active":"2023-01-25T09:20:01.774267+0000","last_peered":"2023-01-25T09:20:01.774267+0000","last_clean":"2023-01-25T09:20:01.774267+0000","last_became_active":"2023-01-25T09:20:00.582465+0000","last_became_peered":"2023-01-25T09:20:00.582465+0000","last_unstale":"2023-01-25T09:20:01.774267+0000","last_undegraded":"2023-01-25T09:20:01.774267+0000","last_fullsized":"2023-01-25T09:20:01.774267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:22.832943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.820176+0000","last_change":"2023-01-25T09:20:01.290672+0000","last_active":"2023-01-25T09:20:01.820176+0000","last_peered":"2023-01-25T09:20:01.820176+0000","last_clean":"2023-01-25T09:20:01.820176+0000","last_became_active":"2023-01-25T09:20:01.289735+0000","last_became_peered":"2023-01-25T09:20:01.289735+0000","last_unstale":"2023-01-25T09:20:01.820176+0000","last_undegraded":"2023-01-25T09:20:01.820176+0000","last_fullsized":"2023-01-25T09:20:01.820176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:03.679432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.774199+0000","last_change":"2023-01-25T09:20:00.583794+0000","last_active":"2023-01-25T09:20:01.774199+0000","last_peered":"2023-01-25T09:20:01.774199+0000","last_clean":"2023-01-25T09:20:01.774199+0000","last_became_active":"2023-01-25T09:20:00.583095+0000","last_became_peered":"2023-01-25T09:20:00.583095+0000","last_unstale":"2023-01-25T09:20:01.774199+0000","last_undegraded":"2023-01-25T09:20:01.774199+0000","last_fullsized":"2023-01-25T09:20:01.774199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:08.981177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1150976,"data_stored":1140304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":3,"acting":3,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6248,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365592,"statfs":{"total":96636764160,"available":96630366208,"internally_reserved":0,"allocated":626688,"data_stored":516063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":651.52200000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5744,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366096,"statfs":{"total":96636764160,"available":96630882304,"internally_reserved":0,"allocated":565248,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5412,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366428,"statfs":{"total":96636764160,"available":96631222272,"internally_reserved":0,"allocated":290816,"data_stored":182853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":205328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:20:06.033 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T09:20:06.033 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-25T09:20:06.033 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-25T09:20:06.034 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-25T09:20:06.349 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:20:06.349 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-25T09:20:06.362 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-25T09:20:06.363 INFO:teuthology.run_tasks:Running task thrashosds... 2023-01-25T09:20:06.373 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-25T09:20:06.374 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri6-testing-2023-01-24-0746'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-yuri6-testing-2023-01-24-0746', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}} 2023-01-25T09:20:06.374 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4} 2023-01-25T09:20:06.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-01-25T09:20:06.689 INFO:tasks.thrashosds:Beginning thrashosds... 2023-01-25T09:20:06.689 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T09:20:06.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:20:06.989 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:20:06.992 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-01-25T09:20:07.004 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T09:20:05.389544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":42716,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":40000,"kb_avail":754932004,"statfs":{"total":773094113280,"available":773050372096,"internally_reserved":0,"allocated":2260992,"data_stored":1395882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40960000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":47,"num_write":81,"num_write_kb":1567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000730"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.805191+0000","last_change":"2023-01-25T09:20:00.581551+0000","last_active":"2023-01-25T09:20:01.805191+0000","last_peered":"2023-01-25T09:20:01.805191+0000","last_clean":"2023-01-25T09:20:01.805191+0000","last_became_active":"2023-01-25T09:20:00.581080+0000","last_became_peered":"2023-01-25T09:20:00.581080+0000","last_unstale":"2023-01-25T09:20:01.805191+0000","last_undegraded":"2023-01-25T09:20:01.805191+0000","last_fullsized":"2023-01-25T09:20:01.805191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:05.252876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.805119+0000","last_change":"2023-01-25T09:20:00.578486+0000","last_active":"2023-01-25T09:20:01.805119+0000","last_peered":"2023-01-25T09:20:01.805119+0000","last_clean":"2023-01-25T09:20:01.805119+0000","last_became_active":"2023-01-25T09:20:00.578131+0000","last_became_peered":"2023-01-25T09:20:00.578131+0000","last_unstale":"2023-01-25T09:20:01.805119+0000","last_undegraded":"2023-01-25T09:20:01.805119+0000","last_fullsized":"2023-01-25T09:20:01.805119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:13.562173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.579717+0000","last_change":"2023-01-25T09:20:01.290335+0000","last_active":"2023-01-25T09:20:01.579717+0000","last_peered":"2023-01-25T09:20:01.579717+0000","last_clean":"2023-01-25T09:20:01.579717+0000","last_became_active":"2023-01-25T09:20:01.289388+0000","last_became_peered":"2023-01-25T09:20:01.289388+0000","last_unstale":"2023-01-25T09:20:01.579717+0000","last_undegraded":"2023-01-25T09:20:01.579717+0000","last_fullsized":"2023-01-25T09:20:01.579717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:21.458695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.573134+0000","last_change":"2023-01-25T09:20:00.580834+0000","last_active":"2023-01-25T09:20:01.573134+0000","last_peered":"2023-01-25T09:20:01.573134+0000","last_clean":"2023-01-25T09:20:01.573134+0000","last_became_active":"2023-01-25T09:20:00.580323+0000","last_became_peered":"2023-01-25T09:20:00.580323+0000","last_unstale":"2023-01-25T09:20:01.573134+0000","last_undegraded":"2023-01-25T09:20:01.573134+0000","last_fullsized":"2023-01-25T09:20:01.573134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:12.255086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'105","reported_seq":146,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:02.971076+0000","last_change":"2023-01-25T09:20:00.583208+0000","last_active":"2023-01-25T09:20:02.971076+0000","last_peered":"2023-01-25T09:20:02.971076+0000","last_clean":"2023-01-25T09:20:02.971076+0000","last_became_active":"2023-01-25T09:20:00.582552+0000","last_became_peered":"2023-01-25T09:20:00.582552+0000","last_unstale":"2023-01-25T09:20:02.971076+0000","last_undegraded":"2023-01-25T09:20:02.971076+0000","last_fullsized":"2023-01-25T09:20:02.971076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:06.215489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.519839+0000","last_change":"2023-01-25T09:20:00.576611+0000","last_active":"2023-01-25T09:20:01.519839+0000","last_peered":"2023-01-25T09:20:01.519839+0000","last_clean":"2023-01-25T09:20:01.519839+0000","last_became_active":"2023-01-25T09:20:00.575958+0000","last_became_peered":"2023-01-25T09:20:00.575958+0000","last_unstale":"2023-01-25T09:20:01.519839+0000","last_undegraded":"2023-01-25T09:20:01.519839+0000","last_fullsized":"2023-01-25T09:20:01.519839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:19.955308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.774267+0000","last_change":"2023-01-25T09:20:00.582891+0000","last_active":"2023-01-25T09:20:01.774267+0000","last_peered":"2023-01-25T09:20:01.774267+0000","last_clean":"2023-01-25T09:20:01.774267+0000","last_became_active":"2023-01-25T09:20:00.582465+0000","last_became_peered":"2023-01-25T09:20:00.582465+0000","last_unstale":"2023-01-25T09:20:01.774267+0000","last_undegraded":"2023-01-25T09:20:01.774267+0000","last_fullsized":"2023-01-25T09:20:01.774267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:22.832943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.820176+0000","last_change":"2023-01-25T09:20:01.290672+0000","last_active":"2023-01-25T09:20:01.820176+0000","last_peered":"2023-01-25T09:20:01.820176+0000","last_clean":"2023-01-25T09:20:01.820176+0000","last_became_active":"2023-01-25T09:20:01.289735+0000","last_became_peered":"2023-01-25T09:20:01.289735+0000","last_unstale":"2023-01-25T09:20:01.820176+0000","last_undegraded":"2023-01-25T09:20:01.820176+0000","last_fullsized":"2023-01-25T09:20:01.820176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:03.679432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.774199+0000","last_change":"2023-01-25T09:20:00.583794+0000","last_active":"2023-01-25T09:20:01.774199+0000","last_peered":"2023-01-25T09:20:01.774199+0000","last_clean":"2023-01-25T09:20:01.774199+0000","last_became_active":"2023-01-25T09:20:00.583095+0000","last_became_peered":"2023-01-25T09:20:00.583095+0000","last_unstale":"2023-01-25T09:20:01.774199+0000","last_undegraded":"2023-01-25T09:20:01.774199+0000","last_fullsized":"2023-01-25T09:20:01.774199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:08.981177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1150976,"data_stored":1140304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":3,"acting":3,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6248,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365592,"statfs":{"total":96636764160,"available":96630366208,"internally_reserved":0,"allocated":626688,"data_stored":516063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":651.52200000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5744,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366096,"statfs":{"total":96636764160,"available":96630882304,"internally_reserved":0,"allocated":565248,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5412,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366428,"statfs":{"total":96636764160,"available":96631222272,"internally_reserved":0,"allocated":290816,"data_stored":182853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":205328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:20:07.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:20:07.307 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-01-25T09:20:07.311 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-01-25T09:20:07.322 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T09:20:05.389544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":42716,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":40000,"kb_avail":754932004,"statfs":{"total":773094113280,"available":773050372096,"internally_reserved":0,"allocated":2260992,"data_stored":1395882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40960000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":47,"num_write":81,"num_write_kb":1567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000730"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.805191+0000","last_change":"2023-01-25T09:20:00.581551+0000","last_active":"2023-01-25T09:20:01.805191+0000","last_peered":"2023-01-25T09:20:01.805191+0000","last_clean":"2023-01-25T09:20:01.805191+0000","last_became_active":"2023-01-25T09:20:00.581080+0000","last_became_peered":"2023-01-25T09:20:00.581080+0000","last_unstale":"2023-01-25T09:20:01.805191+0000","last_undegraded":"2023-01-25T09:20:01.805191+0000","last_fullsized":"2023-01-25T09:20:01.805191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:05.252876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.805119+0000","last_change":"2023-01-25T09:20:00.578486+0000","last_active":"2023-01-25T09:20:01.805119+0000","last_peered":"2023-01-25T09:20:01.805119+0000","last_clean":"2023-01-25T09:20:01.805119+0000","last_became_active":"2023-01-25T09:20:00.578131+0000","last_became_peered":"2023-01-25T09:20:00.578131+0000","last_unstale":"2023-01-25T09:20:01.805119+0000","last_undegraded":"2023-01-25T09:20:01.805119+0000","last_fullsized":"2023-01-25T09:20:01.805119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:13.562173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.579717+0000","last_change":"2023-01-25T09:20:01.290335+0000","last_active":"2023-01-25T09:20:01.579717+0000","last_peered":"2023-01-25T09:20:01.579717+0000","last_clean":"2023-01-25T09:20:01.579717+0000","last_became_active":"2023-01-25T09:20:01.289388+0000","last_became_peered":"2023-01-25T09:20:01.289388+0000","last_unstale":"2023-01-25T09:20:01.579717+0000","last_undegraded":"2023-01-25T09:20:01.579717+0000","last_fullsized":"2023-01-25T09:20:01.579717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:21.458695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.573134+0000","last_change":"2023-01-25T09:20:00.580834+0000","last_active":"2023-01-25T09:20:01.573134+0000","last_peered":"2023-01-25T09:20:01.573134+0000","last_clean":"2023-01-25T09:20:01.573134+0000","last_became_active":"2023-01-25T09:20:00.580323+0000","last_became_peered":"2023-01-25T09:20:00.580323+0000","last_unstale":"2023-01-25T09:20:01.573134+0000","last_undegraded":"2023-01-25T09:20:01.573134+0000","last_fullsized":"2023-01-25T09:20:01.573134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:12.255086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'105","reported_seq":146,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:02.971076+0000","last_change":"2023-01-25T09:20:00.583208+0000","last_active":"2023-01-25T09:20:02.971076+0000","last_peered":"2023-01-25T09:20:02.971076+0000","last_clean":"2023-01-25T09:20:02.971076+0000","last_became_active":"2023-01-25T09:20:00.582552+0000","last_became_peered":"2023-01-25T09:20:00.582552+0000","last_unstale":"2023-01-25T09:20:02.971076+0000","last_undegraded":"2023-01-25T09:20:02.971076+0000","last_fullsized":"2023-01-25T09:20:02.971076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:06.215489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.519839+0000","last_change":"2023-01-25T09:20:00.576611+0000","last_active":"2023-01-25T09:20:01.519839+0000","last_peered":"2023-01-25T09:20:01.519839+0000","last_clean":"2023-01-25T09:20:01.519839+0000","last_became_active":"2023-01-25T09:20:00.575958+0000","last_became_peered":"2023-01-25T09:20:00.575958+0000","last_unstale":"2023-01-25T09:20:01.519839+0000","last_undegraded":"2023-01-25T09:20:01.519839+0000","last_fullsized":"2023-01-25T09:20:01.519839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:19.955308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.774267+0000","last_change":"2023-01-25T09:20:00.582891+0000","last_active":"2023-01-25T09:20:01.774267+0000","last_peered":"2023-01-25T09:20:01.774267+0000","last_clean":"2023-01-25T09:20:01.774267+0000","last_became_active":"2023-01-25T09:20:00.582465+0000","last_became_peered":"2023-01-25T09:20:00.582465+0000","last_unstale":"2023-01-25T09:20:01.774267+0000","last_undegraded":"2023-01-25T09:20:01.774267+0000","last_fullsized":"2023-01-25T09:20:01.774267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:22.832943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.820176+0000","last_change":"2023-01-25T09:20:01.290672+0000","last_active":"2023-01-25T09:20:01.820176+0000","last_peered":"2023-01-25T09:20:01.820176+0000","last_clean":"2023-01-25T09:20:01.820176+0000","last_became_active":"2023-01-25T09:20:01.289735+0000","last_became_peered":"2023-01-25T09:20:01.289735+0000","last_unstale":"2023-01-25T09:20:01.820176+0000","last_undegraded":"2023-01-25T09:20:01.820176+0000","last_fullsized":"2023-01-25T09:20:01.820176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:03.679432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:20:01.774199+0000","last_change":"2023-01-25T09:20:00.583794+0000","last_active":"2023-01-25T09:20:01.774199+0000","last_peered":"2023-01-25T09:20:01.774199+0000","last_clean":"2023-01-25T09:20:01.774199+0000","last_became_active":"2023-01-25T09:20:00.583095+0000","last_became_peered":"2023-01-25T09:20:00.583095+0000","last_unstale":"2023-01-25T09:20:01.774199+0000","last_undegraded":"2023-01-25T09:20:01.774199+0000","last_fullsized":"2023-01-25T09:20:01.774199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:19:59.540568+0000","last_clean_scrub_stamp":"2023-01-25T09:19:59.540568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:21:08.981177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1150976,"data_stored":1140304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":3,"acting":3,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6248,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365592,"statfs":{"total":96636764160,"available":96630366208,"internally_reserved":0,"allocated":626688,"data_stored":516063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5088,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366752,"statfs":{"total":96636764160,"available":96631554048,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":651.52200000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5744,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":94366096,"statfs":{"total":96636764160,"available":96630882304,"internally_reserved":0,"allocated":565248,"data_stored":454091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5412,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366428,"statfs":{"total":96636764160,"available":96631222272,"internally_reserved":0,"allocated":290816,"data_stored":182853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":205328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:20:07.324 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T09:20:07.324 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-01-25T09:20:07.630 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 18 2023-01-25T09:20:07.631 INFO:teuthology.orchestra.run.smithi019.stdout:fsid ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1 2023-01-25T09:20:07.631 INFO:teuthology.orchestra.run.smithi019.stdout:created 2023-01-25T09:19:48.383904+0000 2023-01-25T09:20:07.631 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2023-01-25T09:20:01.561393+0000 2023-01-25T09:20:07.631 INFO:teuthology.orchestra.run.smithi019.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-25T09:20:07.631 INFO:teuthology.orchestra.run.smithi019.stdout:crush_version 5 2023-01-25T09:20:07.632 INFO:teuthology.orchestra.run.smithi019.stdout:full_ratio 0.95 2023-01-25T09:20:07.632 INFO:teuthology.orchestra.run.smithi019.stdout:backfillfull_ratio 0.9 2023-01-25T09:20:07.632 INFO:teuthology.orchestra.run.smithi019.stdout:nearfull_ratio 0.85 2023-01-25T09:20:07.632 INFO:teuthology.orchestra.run.smithi019.stdout:require_min_compat_client luminous 2023-01-25T09:20:07.633 INFO:teuthology.orchestra.run.smithi019.stdout:min_compat_client jewel 2023-01-25T09:20:07.633 INFO:teuthology.orchestra.run.smithi019.stdout:require_osd_release reef 2023-01-25T09:20:07.633 INFO:teuthology.orchestra.run.smithi019.stdout:stretch_mode_enabled false 2023-01-25T09:20:07.633 INFO:teuthology.orchestra.run.smithi019.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 application rbd 2023-01-25T09:20:07.633 INFO:teuthology.orchestra.run.smithi019.stdout:pool 2 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-01-25T09:20:07.634 INFO:teuthology.orchestra.run.smithi019.stdout:max_osd 8 2023-01-25T09:20:07.634 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.19:6800/27870 v2:172.21.15.19:6801/27870 exists,up 53fdbafb-c0a6-4c57-98cf-7cd05147b38a 2023-01-25T09:20:07.634 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.19:6804/27874 v2:172.21.15.19:6806/27874 exists,up 947d4652-4756-4b6b-812f-c9efc443df03 2023-01-25T09:20:07.634 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.19:6812/27876 v2:172.21.15.19:6813/27876 exists,up 870a632b-a4a8-4b5b-bc96-d48d8144e753 2023-01-25T09:20:07.634 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.19:6805/27877 v2:172.21.15.19:6807/27877 exists,up 6da8a837-126b-443e-bcdd-0b4ea6385cac 2023-01-25T09:20:07.635 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.106:6808/28008 v2:172.21.15.106:6809/28008 exists,up a0bbe4b6-09df-418c-8b28-b215ca749006 2023-01-25T09:20:07.635 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.106:6800/28005 v2:172.21.15.106:6801/28005 exists,up 1435c1b5-9a3b-472e-8a3d-26a4ff408edd 2023-01-25T09:20:07.635 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.106:6804/28006 v2:172.21.15.106:6805/28006 exists,up a52c4e29-2070-4066-a8c1-f8f7b597b456 2023-01-25T09:20:07.635 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.106:6812/28007 v2:172.21.15.106:6813/28007 exists,up e5f4dc2d-cda8-4c86-a6e8-0727404f5d3d 2023-01-25T09:20:07.645 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.19:6800/27870 v2:172.21.15.19:6801/27870 exists,up 53fdbafb-c0a6-4c57-98cf-7cd05147b38a', 'osd.1 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.19:6804/27874 v2:172.21.15.19:6806/27874 exists,up 947d4652-4756-4b6b-812f-c9efc443df03', 'osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.19:6812/27876 v2:172.21.15.19:6813/27876 exists,up 870a632b-a4a8-4b5b-bc96-d48d8144e753', 'osd.3 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.19:6805/27877 v2:172.21.15.19:6807/27877 exists,up 6da8a837-126b-443e-bcdd-0b4ea6385cac', 'osd.4 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.106:6808/28008 v2:172.21.15.106:6809/28008 exists,up a0bbe4b6-09df-418c-8b28-b215ca749006', 'osd.5 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.106:6800/28005 v2:172.21.15.106:6801/28005 exists,up 1435c1b5-9a3b-472e-8a3d-26a4ff408edd', 'osd.6 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.106:6804/28006 v2:172.21.15.106:6805/28006 exists,up a52c4e29-2070-4066-a8c1-f8f7b597b456', 'osd.7 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v2:172.21.15.106:6812/28007 v2:172.21.15.106:6813/28007 exists,up e5f4dc2d-cda8-4c86-a6e8-0727404f5d3d'] 2023-01-25T09:20:07.645 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-01-25T09:20:07.747 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-01-25T09:20:07.747 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mon.a", 2023-01-25T09:20:07.747 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster": "ceph", 2023-01-25T09:20:07.748 INFO:teuthology.orchestra.run.smithi019.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-01-25T09:20:07.748 INFO:teuthology.orchestra.run.smithi019.stdout: "admin_socket_mode": "", 2023-01-25T09:20:07.748 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-01-25T09:20:07.748 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_client_required": "cephx, none", 2023-01-25T09:20:07.748 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_cluster_required": "cephx", 2023-01-25T09:20:07.749 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_debug": "true", 2023-01-25T09:20:07.749 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-01-25T09:20:07.749 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-01-25T09:20:07.749 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_service_required": "cephx", 2023-01-25T09:20:07.749 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_service_ticket_ttl": "240.000000", 2023-01-25T09:20:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_supported": "cephx", 2023-01-25T09:20:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio": "true", 2023-01-25T09:20:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_max_queue_depth": "1024", 2023-01-25T09:20:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_poll_ms": "250", 2023-01-25T09:20:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_reap_max": "16", 2023-01-25T09:20:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_async_discard": "false", 2023-01-25T09:20:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_block_size": "4096", 2023-01-25T09:20:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio": "false", 2023-01-25T09:20:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-01-25T09:20:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-01-25T09:20:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_inflight_ios": "false", 2023-01-25T09:20:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_enable_discard": "false", 2023-01-25T09:20:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_flock_retry": "3", 2023-01-25T09:20:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_flock_retry_interval": "0.100000", 2023-01-25T09:20:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_inject_crash": "0", 2023-01-25T09:20:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_inject_crash_flush_delay": "2", 2023-01-25T09:20:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring": "false", 2023-01-25T09:20:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring_hipri": "false", 2023-01-25T09:20:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring_sqthread_poll": "false", 2023-01-25T09:20:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-01-25T09:20:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_read_buffer_alignment": "4096", 2023-01-25T09:20:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-01-25T09:20:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_type": "", 2023-01-25T09:20:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_alloc_size": "1048576", 2023-01-25T09:20:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_allocator": "hybrid", 2023-01-25T09:20:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_buffered_io": "true", 2023-01-25T09:20:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_for_zeros": "false", 2023-01-25T09:20:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_volume_selector_often": "false", 2023-01-25T09:20:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-01-25T09:20:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_compact_log_sync": "false", 2023-01-25T09:20:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-01-25T09:20:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_compact_min_size": "16777216", 2023-01-25T09:20:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_replay_check_allocations": "true", 2023-01-25T09:20:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_max_log_runway": "4194304", 2023-01-25T09:20:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_max_prefetch": "1048576", 2023-01-25T09:20:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_min_flush_size": "524288", 2023-01-25T09:20:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_min_log_runway": "1048576", 2023-01-25T09:20:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_replay_recovery": "false", 2023-01-25T09:20:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-01-25T09:20:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_shared_alloc_size": "65536", 2023-01-25T09:20:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_sync_write": "false", 2023-01-25T09:20:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-01-25T09:20:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-01-25T09:20:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-01-25T09:20:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_allocation_from_file": "true", 2023-01-25T09:20:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_allocator": "hybrid", 2023-01-25T09:20:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-01-25T09:20:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-01-25T09:20:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-01-25T09:20:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-01-25T09:20:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-01-25T09:20:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-01-25T09:20:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blobid_prealloc": "10240", 2023-01-25T09:20:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_create": "true", 2023-01-25T09:20:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_create": "false", 2023-01-25T09:20:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_path": "", 2023-01-25T09:20:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_size": "0", 2023-01-25T09:20:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_path": "", 2023-01-25T09:20:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_preallocate_file": "false", 2023-01-25T09:20:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_size": "107374182400", 2023-01-25T09:20:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_create": "false", 2023-01-25T09:20:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_path": "", 2023-01-25T09:20:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_size": "100663296", 2023-01-25T09:20:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs": "true", 2023-01-25T09:20:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-01-25T09:20:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_env_mirror": "false", 2023-01-25T09:20:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-01-25T09:20:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-01-25T09:20:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T09:20:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T09:20:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-01-25T09:20:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T09:20:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_autotune": "true", 2023-01-25T09:20:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-01-25T09:20:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-01-25T09:20:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-01-25T09:20:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-01-25T09:20:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size": "0", 2023-01-25T09:20:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-01-25T09:20:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-01-25T09:20:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-01-25T09:20:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-01-25T09:20:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_type": "2q", 2023-01-25T09:20:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-01-25T09:20:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_clone_cow": "true", 2023-01-25T09:20:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_algorithm": "snappy", 2023-01-25T09:20:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size": "0", 2023-01-25T09:20:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-01-25T09:20:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-01-25T09:20:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size": "0", 2023-01-25T09:20:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-01-25T09:20:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-01-25T09:20:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_mode": "none", 2023-01-25T09:20:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-01-25T09:20:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_csum_type": "crc32c", 2023-01-25T09:20:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_enforce_settings": "default", 2023-01-25T09:20:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_freelist": "false", 2023-01-25T09:20:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_fsck_abort": "false", 2023-01-25T09:20:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-01-25T09:20:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_bug21040": "false", 2023-01-25T09:20:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-01-25T09:20:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_read_err": "false", 2023-01-25T09:20:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_legacy_omap": "false", 2023-01-25T09:20:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-01-25T09:20:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-01-25T09:20:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-01-25T09:20:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-01-25T09:20:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_prefill": "0.000000", 2023-01-25T09:20:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-01-25T09:20:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-01-25T09:20:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-01-25T09:20:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_small_allocations": "0", 2023-01-25T09:20:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-01-25T09:20:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_default_buffered_read": "true", 2023-01-25T09:20:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_default_buffered_write": "false", 2023-01-25T09:20:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops": "0", 2023-01-25T09:20:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-01-25T09:20:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-01-25T09:20:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-01-25T09:20:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-01-25T09:20:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-01-25T09:20:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-01-25T09:20:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-01-25T09:20:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fail_eio": "false", 2023-01-25T09:20:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-01-25T09:20:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-01-25T09:20:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-01-25T09:20:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-01-25T09:20:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mkfs": "true", 2023-01-25T09:20:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-01-25T09:20:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mount": "false", 2023-01-25T09:20:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-01-25T09:20:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_umount": "false", 2023-01-25T09:20:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-01-25T09:20:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-01-25T09:20:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-01-25T09:20:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-01-25T09:20:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-01-25T09:20:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-01-25T09:20:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-01-25T09:20:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-01-25T09:20:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_ignore_data_csum": "false", 2023-01-25T09:20:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-01-25T09:20:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_kvbackend": "rocksdb", 2023-01-25T09:20:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-01-25T09:20:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-01-25T09:20:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_op_age": "5.000000", 2023-01-25T09:20:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_alloc_size": "0", 2023-01-25T09:20:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size": "0", 2023-01-25T09:20:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-01-25T09:20:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-01-25T09:20:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_defer_interval": "3.000000", 2023-01-25T09:20:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_deferred_txc": "32", 2023-01-25T09:20:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size": "0", 2023-01-25T09:20:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-01-25T09:20:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-01-25T09:20:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_nid_prealloc": "1024", 2023-01-25T09:20:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size": "0", 2023-01-25T09:20:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-01-25T09:20:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-01-25T09:20:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_qfsck_on_mount": "true", 2023-01-25T09:20:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_retry_disk_reads": "3", 2023-01-25T09:20:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_cf": "true", 2023-01-25T09:20:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2023-01-25T09:20:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=128,min_write_buffer_number_to_merge=16,compaction_style=kCompactionStyleLevel,write_buffer_size=8388608,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0,ttl=21600", 2023-01-25T09:20:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_options_annex": "", 2023-01-25T09:20:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_coremask": "0x1", 2023-01-25T09:20:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_io_sleep": "5", 2023-01-25T09:20:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_max_io_completion": "0", 2023-01-25T09:20:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_mem": "512", 2023-01-25T09:20:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_sync_submit_transaction": "false", 2023-01-25T09:20:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_bytes": "67108864", 2023-01-25T09:20:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io": "0", 2023-01-25T09:20:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-01-25T09:20:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-01-25T09:20:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-01-25T09:20:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-01-25T09:20:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_tracing": "false", 2023-01-25T09:20:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-01-25T09:20:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-01-25T09:20:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_reserved": "0", 2023-01-25T09:20:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-01-25T09:20:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-01-25T09:20:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-01-25T09:20:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-01-25T09:20:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-01-25T09:20:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-01-25T09:20:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_zero_block_detection": "false", 2023-01-25T09:20:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-01-25T09:20:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_action_update_interval": "2", 2023-01-25T09:20:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-01-25T09:20:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-01-25T09:20:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-01-25T09:20:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-01-25T09:20:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_mount_timeout": "10", 2023-01-25T09:20:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-01-25T09:20:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-01-25T09:20:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-01-25T09:20:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-01-25T09:20:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-01-25T09:20:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-01-25T09:20:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_cluster_require_signatures": "false", 2023-01-25T09:20:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_cluster_require_version": "2", 2023-01-25T09:20:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_require_signatures": "false", 2023-01-25T09:20:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_require_version": "2", 2023-01-25T09:20:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_service_require_signatures": "false", 2023-01-25T09:20:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_service_require_version": "2", 2023-01-25T09:20:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_sign_messages": "true", 2023-01-25T09:20:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "chdir": "", 2023-01-25T09:20:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "client_acl_type": "", 2023-01-25T09:20:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "client_asio_thread_count": "2", 2023-01-25T09:20:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "client_cache_mid": "0.750000", 2023-01-25T09:20:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "client_cache_size": "16384", 2023-01-25T09:20:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "client_caps_release_delay": "5", 2023-01-25T09:20:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_check_pool_perm": "true", 2023-01-25T09:20:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_collect_and_send_global_metrics": "false", 2023-01-25T09:20:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_force_sync_read": "false", 2023-01-25T09:20:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_getattr_caps": "false", 2023-01-25T09:20:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_inject_tick_delay": "0", 2023-01-25T09:20:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-01-25T09:20:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "client_die_on_failed_remount": "false", 2023-01-25T09:20:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "client_dirsize_rbytes": "true", 2023-01-25T09:20:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "client_force_lazyio": "false", 2023-01-25T09:20:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "client_fs": "", 2023-01-25T09:20:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_inject_fixed_oldest_tid": "false", 2023-01-25T09:20:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_inject_release_failure": "false", 2023-01-25T09:20:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_max_inline_size": "4096", 2023-01-25T09:20:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mds_namespace": "", 2023-01-25T09:20:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_metadata": "", 2023-01-25T09:20:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_gid": "-1", 2023-01-25T09:20:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_timeout": "300", 2023-01-25T09:20:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_uid": "-1", 2023-01-25T09:20:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mountpoint": "/", 2023-01-25T09:20:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_notify_timeout": "10", 2023-01-25T09:20:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc": "true", 2023-01-25T09:20:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_dirty": "104857600", 2023-01-25T09:20:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_dirty_age": "5.000000", 2023-01-25T09:20:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_objects": "1000", 2023-01-25T09:20:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_size": "209715200", 2023-01-25T09:20:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_target_dirty": "8388608", 2023-01-25T09:20:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "client_permissions": "true", 2023-01-25T09:20:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "client_quota": "true", 2023-01-25T09:20:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "client_quota_df": "true", 2023-01-25T09:20:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_max_bytes": "0", 2023-01-25T09:20:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_max_periods": "4", 2023-01-25T09:20:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_min": "131072", 2023-01-25T09:20:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_reconnect_stale": "false", 2023-01-25T09:20:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_shutdown_timeout": "30", 2023-01-25T09:20:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_snapdir": ".snap", 2023-01-25T09:20:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_tick_interval": "1", 2023-01-25T09:20:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_trace": "", 2023-01-25T09:20:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "client_try_dentry_invalidate": "false", 2023-01-25T09:20:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "client_use_faked_inos": "false", 2023-01-25T09:20:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "client_use_random_mds": "false", 2023-01-25T09:20:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog": "false", 2023-01-25T09:20:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-01-25T09:20:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog_port": "12201", 2023-01-25T09:20:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_monitors": "default=true", 2023-01-25T09:20:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog": "false", 2023-01-25T09:20:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-01-25T09:20:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog_level": "info", 2023-01-25T09:20:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "-", 2023-01-25T09:20:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_network": "", 2023-01-25T09:20:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_network_interface": "", 2023-01-25T09:20:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_isal": "false", 2023-01-25T09:20:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_level": "5", 2023-01-25T09:20:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_winsize": "-15", 2023-01-25T09:20:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zstd_level": "1", 2023-01-25T09:20:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-01-25T09:20:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-01-25T09:20:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_alien_op_num_threads": "6", 2023-01-25T09:20:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_alien_thread_cpu_cores": "", 2023-01-25T09:20:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_obc_lru_size": "10", 2023-01-25T09:20:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-01-25T09:20:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_seastar_smp": "1", 2023-01-25T09:20:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location": "", 2023-01-25T09:20:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location_hook": "", 2023-01-25T09:20:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location_hook_timeout": "10", 2023-01-25T09:20:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "daemonize": "false", 2023-01-25T09:20:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "daos_pool": "tank", 2023-01-25T09:20:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-01-25T09:20:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-01-25T09:20:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_db_name_prefix": "dbstore", 2023-01-25T09:20:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_alienstore": "0/5", 2023-01-25T09:20:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_allow_any_pool_priority": "false", 2023-01-25T09:20:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asok": "1/5", 2023-01-25T09:20:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asok_assert_abort": "false", 2023-01-25T09:20:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asserts_on_shutdown": "true", 2023-01-25T09:20:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_auth": "20/20", 2023-01-25T09:20:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bdev": "1/3", 2023-01-25T09:20:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bluefs": "1/5", 2023-01-25T09:20:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bluestore": "1/5", 2023-01-25T09:20:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_buffer": "0/1", 2023-01-25T09:20:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ceph_exporter": "1/5", 2023-01-25T09:20:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cephfs_mirror": "0/5", 2023-01-25T09:20:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cephsqlite": "0/5", 2023-01-25T09:20:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_client": "0/5", 2023-01-25T09:20:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_compressor": "1/5", 2023-01-25T09:20:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_context": "0/1", 2023-01-25T09:20:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crush": "1/1", 2023-01-25T09:20:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crypto": "1/5", 2023-01-25T09:20:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cyanstore": "0/5", 2023-01-25T09:20:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_deliberately_leak_memory": "false", 2023-01-25T09:20:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_disable_randomized_ping": "false", 2023-01-25T09:20:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_dpdk": "1/5", 2023-01-25T09:20:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_eventtrace": "1/5", 2023-01-25T09:20:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_filer": "0/1", 2023-01-25T09:20:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_filestore": "1/3", 2023-01-25T09:20:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_finisher": "1/1", 2023-01-25T09:20:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_fuse": "1/5", 2023-01-25T09:20:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_heartbeat_testing_span": "0", 2023-01-25T09:20:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_heartbeatmap": "1/5", 2023-01-25T09:20:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_immutable_obj_cache": "0/5", 2023-01-25T09:20:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_javaclient": "1/5", 2023-01-25T09:20:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_journal": "1/3", 2023-01-25T09:20:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_journaler": "0/5", 2023-01-25T09:20:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_kstore": "1/5", 2023-01-25T09:20:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_leveldb": "4/5", 2023-01-25T09:20:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_lockdep": "0/1", 2023-01-25T09:20:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mclock": "1/5", 2023-01-25T09:20:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds": "1/5", 2023-01-25T09:20:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_balancer": "1/5", 2023-01-25T09:20:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_locker": "1/5", 2023-01-25T09:20:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_log": "1/5", 2023-01-25T09:20:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_log_expire": "1/5", 2023-01-25T09:20:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_migrator": "1/5", 2023-01-25T09:20:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_memstore": "1/5", 2023-01-25T09:20:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mgr": "2/5", 2023-01-25T09:20:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mgrc": "1/5", 2023-01-25T09:20:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mon": "20/20", 2023-01-25T09:20:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_monc": "0/10", 2023-01-25T09:20:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ms": "1/1", 2023-01-25T09:20:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_none": "0/5", 2023-01-25T09:20:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objclass": "0/5", 2023-01-25T09:20:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objectcacher": "0/5", 2023-01-25T09:20:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objecter": "0/1", 2023-01-25T09:20:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_optracker": "0/5", 2023-01-25T09:20:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_osd": "1/5", 2023-01-25T09:20:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_paxos": "20/20", 2023-01-25T09:20:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_perfcounter": "1/5", 2023-01-25T09:20:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_prioritycache": "1/5", 2023-01-25T09:20:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rados": "0/5", 2023-01-25T09:20:07.815 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd": "0/5", 2023-01-25T09:20:07.815 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_mirror": "0/5", 2023-01-25T09:20:07.815 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_pwl": "0/5", 2023-01-25T09:20:07.815 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_replay": "0/5", 2023-01-25T09:20:07.815 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_refs": "0/0", 2023-01-25T09:20:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_reserver": "1/1", 2023-01-25T09:20:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw": "1/5", 2023-01-25T09:20:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_access": "1/5", 2023-01-25T09:20:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_datacache": "1/5", 2023-01-25T09:20:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_dbstore": "1/5", 2023-01-25T09:20:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_flight": "1/5", 2023-01-25T09:20:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_sync": "1/5", 2023-01-25T09:20:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rocksdb": "4/5", 2023-01-25T09:20:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore": "0/5", 2023-01-25T09:20:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_backref": "0/5", 2023-01-25T09:20:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_cache": "0/5", 2023-01-25T09:20:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_cleaner": "0/5", 2023-01-25T09:20:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_device": "0/5", 2023-01-25T09:20:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_epm": "0/5", 2023-01-25T09:20:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-01-25T09:20:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_journal": "0/5", 2023-01-25T09:20:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_lba": "0/5", 2023-01-25T09:20:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_odata": "0/5", 2023-01-25T09:20:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_omap": "0/5", 2023-01-25T09:20:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_onode": "0/5", 2023-01-25T09:20:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_t": "0/5", 2023-01-25T09:20:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_tm": "0/5", 2023-01-25T09:20:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_striper": "0/1", 2023-01-25T09:20:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_test": "0/5", 2023-01-25T09:20:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_throttle": "1/1", 2023-01-25T09:20:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_timer": "0/1", 2023-01-25T09:20:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_tp": "0/5", 2023-01-25T09:20:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "device_failure_prediction_mode": "none", 2023-01-25T09:20:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-01-25T09:20:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2023-01-25T09:20:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_graylog": "false", 2023-01-25T09:20:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_journald": "false", 2023-01-25T09:20:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_stderr": "true", 2023-01-25T09:20:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_syslog": "false", 2023-01-25T09:20:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "event_tracing": "false", 2023-01-25T09:20:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_addr": "0.0.0.0", 2023-01-25T09:20:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_http_port": "9926", 2023-01-25T09:20:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_prio_limit": "5", 2023-01-25T09:20:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-01-25T09:20:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_sort_metrics": "true", 2023-01-25T09:20:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_stats_period": "5", 2023-01-25T09:20:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "fake_statfs_for_testing": "0", 2023-01-25T09:20:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "fatal_signal_handlers": "true", 2023-01-25T09:20:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "filer_max_purge_ops": "10", 2023-01-25T09:20:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "filer_max_truncate_ops": "128", 2023-01-25T09:20:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_apply_finisher_threads": "1", 2023-01-25T09:20:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_blackhole": "false", 2023-01-25T09:20:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_btrfs_clone_range": "true", 2023-01-25T09:20:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_btrfs_snap": "true", 2023-01-25T09:20:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_caller_concurrency": "10", 2023-01-25T09:20:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_collect_device_partition_information": "true", 2023-01-25T09:20:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_commit_timeout": "600.000000", 2023-01-25T09:20:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_inject_read_err": "false", 2023-01-25T09:20:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_omap_check": "false", 2023-01-25T09:20:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_random_read_err": "0.000000", 2023-01-25T09:20:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_verify_split": "false", 2023-01-25T09:20:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_dump_file": "", 2023-01-25T09:20:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-01-25T09:20:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-01-25T09:20:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fadvise": "true", 2023-01-25T09:20:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fail_eio": "true", 2023-01-25T09:20:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fd_cache_shards": "16", 2023-01-25T09:20:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fd_cache_size": "128", 2023-01-25T09:20:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fiemap": "false", 2023-01-25T09:20:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fiemap_threshold": "4096", 2023-01-25T09:20:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-01-25T09:20:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_index_retry_probability": "0.000000", 2023-01-25T09:20:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_inject_stall": "0", 2023-01-25T09:20:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_parallel": "false", 2023-01-25T09:20:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_trailing": "false", 2023-01-25T09:20:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_writeahead": "false", 2023-01-25T09:20:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_kill_at": "0", 2023-01-25T09:20:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-01-25T09:20:07.830 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size": "0", 2023-01-25T09:20:07.830 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-01-25T09:20:07.830 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-01-25T09:20:07.830 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-01-25T09:20:07.830 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs": "0", 2023-01-25T09:20:07.831 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-01-25T09:20:07.831 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_other": "2", 2023-01-25T09:20:07.831 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-01-25T09:20:07.831 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_sync_interval": "5.000000", 2023-01-25T09:20:07.831 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size": "0", 2023-01-25T09:20:07.832 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-01-25T09:20:07.832 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-01-25T09:20:07.832 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-01-25T09:20:07.832 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_merge_threshold": "-10", 2023-01-25T09:20:07.832 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_min_sync_interval": "0.010000", 2023-01-25T09:20:07.833 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_odsync_write": "false", 2023-01-25T09:20:07.833 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_backend": "rocksdb", 2023-01-25T09:20:07.833 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_backend_path": "", 2023-01-25T09:20:07.833 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_header_cache_size": "1024", 2023-01-25T09:20:07.833 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_ondisk_finisher_threads": "1", 2023-01-25T09:20:07.834 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-01-25T09:20:07.834 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_thread_timeout": "60", 2023-01-25T09:20:07.834 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_threads": "2", 2023-01-25T09:20:07.834 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_punch_hole": "false", 2023-01-25T09:20:07.834 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-01-25T09:20:07.835 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-01-25T09:20:07.835 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-01-25T09:20:07.835 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-01-25T09:20:07.835 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-01-25T09:20:07.835 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_bytes": "104857600", 2023-01-25T09:20:07.835 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-01-25T09:20:07.836 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-01-25T09:20:07.836 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-01-25T09:20:07.836 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_ops": "50", 2023-01-25T09:20:07.836 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-01-25T09:20:07.836 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_seek_data_hole": "false", 2023-01-25T09:20:07.837 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_sloppy_crc": "false", 2023-01-25T09:20:07.837 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-01-25T09:20:07.837 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_splice": "false", 2023-01-25T09:20:07.837 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_split_multiple": "2", 2023-01-25T09:20:07.837 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_split_rand_factor": "20", 2023-01-25T09:20:07.838 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_update_to": "1000", 2023-01-25T09:20:07.838 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-01-25T09:20:07.838 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-01-25T09:20:07.838 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-01-25T09:20:07.838 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-01-25T09:20:07.839 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-01-25T09:20:07.839 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-01-25T09:20:07.839 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_enable": "true", 2023-01-25T09:20:07.839 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-01-25T09:20:07.839 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-01-25T09:20:07.840 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-01-25T09:20:07.840 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-01-25T09:20:07.840 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-01-25T09:20:07.840 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-01-25T09:20:07.840 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_xfs_extsize": "false", 2023-01-25T09:20:07.841 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_zfs_snap": "false", 2023-01-25T09:20:07.841 INFO:teuthology.orchestra.run.smithi019.stdout: "fio_dir": "/tmp/fio", 2023-01-25T09:20:07.841 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "ebdd2ff1-8e73-4d3d-8a1e-352eda8223c1", 2023-01-25T09:20:07.841 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_allow_other": "true", 2023-01-25T09:20:07.841 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_atomic_o_trunc": "true", 2023-01-25T09:20:07.841 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_big_writes": "true", 2023-01-25T09:20:07.842 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_debug": "false", 2023-01-25T09:20:07.842 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_default_permissions": "false", 2023-01-25T09:20:07.842 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_disable_pagecache": "false", 2023-01-25T09:20:07.842 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_max_write": "0", 2023-01-25T09:20:07.842 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_multithreaded": "true", 2023-01-25T09:20:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_require_active_mds": "true", 2023-01-25T09:20:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_set_user_groups": "true", 2023-01-25T09:20:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_move": "true", 2023-01-25T09:20:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_read": "true", 2023-01-25T09:20:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_write": "true", 2023-01-25T09:20:07.844 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_syncfs_on_mksnap": "true", 2023-01-25T09:20:07.844 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_use_invalidate_cb": "true", 2023-01-25T09:20:07.844 INFO:teuthology.orchestra.run.smithi019.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-01-25T09:20:07.844 INFO:teuthology.orchestra.run.smithi019.stdout: "gss_target_name": "ceph", 2023-01-25T09:20:07.844 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_file": "", 2023-01-25T09:20:07.845 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_inject_failure": "0", 2023-01-25T09:20:07.845 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_interval": "5", 2023-01-25T09:20:07.845 INFO:teuthology.orchestra.run.smithi019.stdout: "host": "smithi019", 2023-01-25T09:20:07.845 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-01-25T09:20:07.845 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-01-25T09:20:07.846 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_max_size": "1073741824", 2023-01-25T09:20:07.846 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-01-25T09:20:07.846 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-01-25T09:20:07.846 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-01-25T09:20:07.846 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-01-25T09:20:07.847 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-01-25T09:20:07.847 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-01-25T09:20:07.847 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-01-25T09:20:07.847 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-01-25T09:20:07.847 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-01-25T09:20:07.848 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_watermark": "0.900000", 2023-01-25T09:20:07.848 INFO:teuthology.orchestra.run.smithi019.stdout: "inject_early_sigterm": "false", 2023-01-25T09:20:07.848 INFO:teuthology.orchestra.run.smithi019.stdout: "jaeger_tracing_enable": "false", 2023-01-25T09:20:07.848 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_aio": "true", 2023-01-25T09:20:07.848 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_align_min_size": "65536", 2023-01-25T09:20:07.849 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_block_align": "true", 2023-01-25T09:20:07.849 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_block_size": "4096", 2023-01-25T09:20:07.849 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_dio": "true", 2023-01-25T09:20:07.849 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_discard": "false", 2023-01-25T09:20:07.849 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_force_aio": "false", 2023-01-25T09:20:07.850 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_ignore_corruption": "false", 2023-01-25T09:20:07.850 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_max_write_bytes": "10485760", 2023-01-25T09:20:07.850 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_max_write_entries": "100", 2023-01-25T09:20:07.850 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_replay_from": "0", 2023-01-25T09:20:07.850 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_high_multiple": "0.000000", 2023-01-25T09:20:07.851 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-01-25T09:20:07.851 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-01-25T09:20:07.851 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_max_multiple": "0.000000", 2023-01-25T09:20:07.851 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_write_header_frequency": "0", 2023-01-25T09:20:07.851 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_zero_on_create": "false", 2023-01-25T09:20:07.852 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_prefetch_periods": "10", 2023-01-25T09:20:07.852 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_prezero_periods": "5", 2023-01-25T09:20:07.852 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_write_head_interval": "15", 2023-01-25T09:20:07.852 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "", 2023-01-25T09:20:07.852 INFO:teuthology.orchestra.run.smithi019.stdout: "keyfile": "", 2023-01-25T09:20:07.853 INFO:teuthology.orchestra.run.smithi019.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-01-25T09:20:07.853 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_backend": "rocksdb", 2023-01-25T09:20:07.853 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_default_stripe_size": "65536", 2023-01-25T09:20:07.853 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_fsck_on_mount": "false", 2023-01-25T09:20:07.853 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_fsck_on_mount_deep": "true", 2023-01-25T09:20:07.854 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_max_bytes": "67108864", 2023-01-25T09:20:07.854 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_max_ops": "512", 2023-01-25T09:20:07.854 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_nid_prealloc": "1024", 2023-01-25T09:20:07.854 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_onode_map_size": "1024", 2023-01-25T09:20:07.854 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-01-25T09:20:07.855 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_sync_submit_transaction": "false", 2023-01-25T09:20:07.855 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_sync_transaction": "false", 2023-01-25T09:20:07.855 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_block_size": "65536", 2023-01-25T09:20:07.855 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_bloom_size": "0", 2023-01-25T09:20:07.855 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_cache_size": "536870912", 2023-01-25T09:20:07.856 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_compact_on_mount": "false", 2023-01-25T09:20:07.856 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_compression": "false", 2023-01-25T09:20:07.856 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_log": "", 2023-01-25T09:20:07.856 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_log_to_ceph_log": "true", 2023-01-25T09:20:07.856 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_max_open_files": "0", 2023-01-25T09:20:07.857 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_paranoid": "false", 2023-01-25T09:20:07.857 INFO:teuthology.orchestra.run.smithi019.stdout: "leveldb_write_buffer_size": "33554432", 2023-01-25T09:20:07.857 INFO:teuthology.orchestra.run.smithi019.stdout: "librados_thread_count": "2", 2023-01-25T09:20:07.857 INFO:teuthology.orchestra.run.smithi019.stdout: "lockdep": "false", 2023-01-25T09:20:07.857 INFO:teuthology.orchestra.run.smithi019.stdout: "lockdep_force_backtrace": "false", 2023-01-25T09:20:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "log_coarse_timestamps": "true", 2023-01-25T09:20:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-01-25T09:20:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "log_flush_on_exit": "false", 2023-01-25T09:20:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "log_graylog_host": "127.0.0.1", 2023-01-25T09:20:07.858 INFO:teuthology.orchestra.run.smithi019.stdout: "log_graylog_port": "12201", 2023-01-25T09:20:07.859 INFO:teuthology.orchestra.run.smithi019.stdout: "log_max_new": "1000", 2023-01-25T09:20:07.859 INFO:teuthology.orchestra.run.smithi019.stdout: "log_max_recent": "10000", 2023-01-25T09:20:07.859 INFO:teuthology.orchestra.run.smithi019.stdout: "log_stderr_prefix": "", 2023-01-25T09:20:07.859 INFO:teuthology.orchestra.run.smithi019.stdout: "log_stop_at_utilization": "0.970000", 2023-01-25T09:20:07.859 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": "true", 2023-01-25T09:20:07.859 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_graylog": "false", 2023-01-25T09:20:07.860 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_journald": "false", 2023-01-25T09:20:07.860 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_stderr": "false", 2023-01-25T09:20:07.860 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_syslog": "false", 2023-01-25T09:20:07.860 INFO:teuthology.orchestra.run.smithi019.stdout: "max_rotating_auth_attempts": "10", 2023-01-25T09:20:07.861 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_action_on_write_error": "1", 2023-01-25T09:20:07.861 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_alternate_name_max": "8192", 2023-01-25T09:20:07.861 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_asio_thread_count": "2", 2023-01-25T09:20:07.861 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_export_pin": "true", 2023-01-25T09:20:07.861 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_dirs": "true", 2023-01-25T09:20:07.862 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-01-25T09:20:07.862 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_interval": "5", 2023-01-25T09:20:07.862 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_size_max": "100000", 2023-01-25T09:20:07.862 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_idle_threshold": "0.000000", 2023-01-25T09:20:07.862 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_interval": "10", 2023-01-25T09:20:07.863 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_max": "-1", 2023-01-25T09:20:07.863 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_max_until": "-1", 2023-01-25T09:20:07.863 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_merge_size": "50", 2023-01-25T09:20:07.863 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_midchunk": "0.300000", 2023-01-25T09:20:07.863 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_min_rebalance": "0.100000", 2023-01-25T09:20:07.864 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_min_start": "0.200000", 2023-01-25T09:20:07.864 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_minchunk": "0.001000", 2023-01-25T09:20:07.864 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_mode": "0", 2023-01-25T09:20:07.864 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_need_max": "1.200000", 2023-01-25T09:20:07.864 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_need_min": "0.800000", 2023-01-25T09:20:07.865 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-01-25T09:20:07.865 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_sample_interval": "3.000000", 2023-01-25T09:20:07.865 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_bits": "3", 2023-01-25T09:20:07.865 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_rd": "25000.000000", 2023-01-25T09:20:07.865 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_size": "10000", 2023-01-25T09:20:07.866 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_wr": "10000.000000", 2023-01-25T09:20:07.866 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_target_decay": "10.000000", 2023-01-25T09:20:07.866 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-01-25T09:20:07.866 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_grace": "15.000000", 2023-01-25T09:20:07.866 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_interval": "4.000000", 2023-01-25T09:20:07.867 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_mon_down_grace": "60", 2023-01-25T09:20:07.867 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_memory_limit": "4294967296", 2023-01-25T09:20:07.867 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_mid": "0.700000", 2023-01-25T09:20:07.867 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_release_free_interval": "10", 2023-01-25T09:20:07.867 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_reservation": "0.050000", 2023-01-25T09:20:07.868 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-01-25T09:20:07.868 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_interval": "1", 2023-01-25T09:20:07.868 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_threshold": "262144", 2023-01-25T09:20:07.868 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-01-25T09:20:07.868 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-01-25T09:20:07.869 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_delegate_inos_pct": "50", 2023-01-25T09:20:07.869 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_prealloc_inos": "1000", 2023-01-25T09:20:07.869 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-01-25T09:20:07.869 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_connect_bootstrapping": "false", 2023-01-25T09:20:07.869 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_damage_table_max_entries": "10000", 2023-01-25T09:20:07.870 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-01-25T09:20:07.870 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_auth_pins": "false", 2023-01-25T09:20:07.870 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_frag": "false", 2023-01-25T09:20:07.870 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_scatterstat": "false", 2023-01-25T09:20:07.870 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_subtrees": "false", 2023-01-25T09:20:07.871 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_decay_halflife": "5.000000", 2023-01-25T09:20:07.871 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_default_dir_hash": "2", 2023-01-25T09:20:07.871 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_defer_session_stale": "true", 2023-01-25T09:20:07.871 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_deny_all_reconnect": "false", 2023-01-25T09:20:07.871 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_keys_per_op": "16384", 2023-01-25T09:20:07.872 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_max_commit_size": "10", 2023-01-25T09:20:07.872 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_max_entries": "0", 2023-01-25T09:20:07.872 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_prefetch": "true", 2023-01-25T09:20:07.872 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dirstat_min_interval": "1.000000", 2023-01-25T09:20:07.872 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_after_rejoin": "false", 2023-01-25T09:20:07.873 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_on_map": "false", 2023-01-25T09:20:07.873 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_threshold_file": "0", 2023-01-25T09:20:07.873 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-01-25T09:20:07.873 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_early_reply": "true", 2023-01-25T09:20:07.873 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_enable_op_tracker": "true", 2023-01-25T09:20:07.874 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_enforce_unique_name": "true", 2023-01-25T09:20:07.874 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_distributed": "true", 2023-01-25T09:20:07.874 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-01-25T09:20:07.874 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_random": "true", 2023-01-25T09:20:07.874 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-01-25T09:20:07.874 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-01-25T09:20:07.875 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_forward_all_requests_to_auth": "false", 2023-01-25T09:20:07.875 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-01-25T09:20:07.875 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-01-25T09:20:07.875 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-01-25T09:20:07.876 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_health_cache_threshold": "1.500000", 2023-01-25T09:20:07.876 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_health_summarize_threshold": "10", 2023-01-25T09:20:07.876 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_heartbeat_grace": "15.000000", 2023-01-25T09:20:07.876 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_heartbeat_reset_grace": "1000", 2023-01-25T09:20:07.876 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_health_dummy": "false", 2023-01-25T09:20:07.877 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_migrator_session_race": "false", 2023-01-25T09:20:07.877 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-01-25T09:20:07.877 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_join_fs": "", 2023-01-25T09:20:07.877 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_journal_format": "1", 2023-01-25T09:20:07.877 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_create_at": "0", 2023-01-25T09:20:07.878 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_export_at": "0", 2023-01-25T09:20:07.878 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_import_at": "0", 2023-01-25T09:20:07.878 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_at": "0", 2023-01-25T09:20:07.878 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_expire_at": "0", 2023-01-25T09:20:07.878 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_replay_at": "0", 2023-01-25T09:20:07.879 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_link_at": "0", 2023-01-25T09:20:07.879 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_mdstable_at": "0", 2023-01-25T09:20:07.879 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_openc_at": "0", 2023-01-25T09:20:07.879 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_rename_at": "0", 2023-01-25T09:20:07.879 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_events_per_segment": "1024", 2023-01-25T09:20:07.880 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_max_events": "-1", 2023-01-25T09:20:07.880 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_max_segments": "128", 2023-01-25T09:20:07.880 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_pause": "false", 2023-01-25T09:20:07.880 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_segment_size": "0", 2023-01-25T09:20:07.880 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_skip_corrupt_events": "false", 2023-01-25T09:20:07.881 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_warn_factor": "2.000000", 2023-01-25T09:20:07.881 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_caps_per_client": "1048576", 2023-01-25T09:20:07.881 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_completed_flushes": "100000", 2023-01-25T09:20:07.881 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_completed_requests": "100000", 2023-01-25T09:20:07.881 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_export_size": "20971520", 2023-01-25T09:20:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_file_recover": "32", 2023-01-25T09:20:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_files": "64", 2023-01-25T09:20:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_ops": "8192", 2023-01-25T09:20:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-01-25T09:20:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_retries_on_remount_failure": "5", 2023-01-25T09:20:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-01-25T09:20:07.883 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_snaps_per_dir": "100", 2023-01-25T09:20:07.883 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_xattr_pairs_size": "65536", 2023-01-25T09:20:07.883 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_metrics_update_interval": "2", 2023-01-25T09:20:07.883 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_min_caps_per_client": "100", 2023-01-25T09:20:07.884 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_min_caps_working_set": "10000", 2023-01-25T09:20:07.884 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-01-25T09:20:07.884 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_numa_node": "-1", 2023-01-25T09:20:07.884 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-01-25T09:20:07.884 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_complaint_time": "30.000000", 2023-01-25T09:20:07.885 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_duration": "600", 2023-01-25T09:20:07.885 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_size": "20", 2023-01-25T09:20:07.885 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_log_threshold": "5", 2023-01-25T09:20:07.885 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_ping_grace": "15", 2023-01-25T09:20:07.885 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_ping_interval": "5", 2023-01-25T09:20:07.886 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-01-25T09:20:07.886 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-01-25T09:20:07.886 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_caps": "30000", 2023-01-25T09:20:07.886 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-01-25T09:20:07.886 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_decay_threshold": "131072", 2023-01-25T09:20:07.887 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-01-25T09:20:07.887 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_warning_threshold": "262144", 2023-01-25T09:20:07.887 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_reconnect_timeout": "45.000000", 2023-01-25T09:20:07.887 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_replay_interval": "1.000000", 2023-01-25T09:20:07.887 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-01-25T09:20:07.888 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-01-25T09:20:07.888 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_root_ino_gid": "0", 2023-01-25T09:20:07.888 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_root_ino_uid": "0", 2023-01-25T09:20:07.888 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-01-25T09:20:07.888 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_blocklist_on_evict": "true", 2023-01-25T09:20:07.889 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_blocklist_on_timeout": "true", 2023-01-25T09:20:07.889 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-01-25T09:20:07.889 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-01-25T09:20:07.889 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-01-25T09:20:07.889 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-01-25T09:20:07.890 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-01-25T09:20:07.890 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-01-25T09:20:07.890 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_shutdown_check": "0", 2023-01-25T09:20:07.890 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_skip_ino": "0", 2023-01-25T09:20:07.890 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sleep_rank_change": "0.000000", 2023-01-25T09:20:07.891 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_max_uid": "4294967294", 2023-01-25T09:20:07.891 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_min_uid": "0", 2023-01-25T09:20:07.891 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_rstat": "false", 2023-01-25T09:20:07.891 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_standby_replay_damaged": "false", 2023-01-25T09:20:07.891 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_symlink_recovery": "true", 2023-01-25T09:20:07.891 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_task_status_update_interval": "2.000000", 2023-01-25T09:20:07.892 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_thrash_exports": "0", 2023-01-25T09:20:07.892 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_thrash_fragments": "0", 2023-01-25T09:20:07.892 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_tick_interval": "5.000000", 2023-01-25T09:20:07.892 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_valgrind_exit": "false", 2023-01-25T09:20:07.893 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_verify_backtrace": "1", 2023-01-25T09:20:07.893 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_verify_scatter": "false", 2023-01-25T09:20:07.893 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_wipe_ino_prealloc": "false", 2023-01-25T09:20:07.893 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_wipe_sessions": "false", 2023-01-25T09:20:07.893 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool_debug": "false", 2023-01-25T09:20:07.894 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_debug_omit_block_device_write": "false", 2023-01-25T09:20:07.894 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_device_bytes": "1073741824", 2023-01-25T09:20:07.894 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_page_set": "false", 2023-01-25T09:20:07.894 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_page_size": "65536", 2023-01-25T09:20:07.894 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_bytes": "134217728", 2023-01-25T09:20:07.894 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_messages": "512", 2023-01-25T09:20:07.895 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-01-25T09:20:07.895 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_connect_retry_interval": "1.000000", 2023-01-25T09:20:07.895 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-01-25T09:20:07.895 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-01-25T09:20:07.895 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_disabled_modules": "", 2023-01-25T09:20:07.896 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-01-25T09:20:07.896 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_max_pg_num_change": "128", 2023-01-25T09:20:07.896 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mds_bytes": "134217728", 2023-01-25T09:20:07.896 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mds_messages": "128", 2023-01-25T09:20:07.896 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-01-25T09:20:07.897 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mon_bytes": "134217728", 2023-01-25T09:20:07.897 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mon_messages": "128", 2023-01-25T09:20:07.897 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_osd_bytes": "536870912", 2023-01-25T09:20:07.897 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_osd_messages": "8192", 2023-01-25T09:20:07.897 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_pool": "true", 2023-01-25T09:20:07.898 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_service_beacon_grace": "60.000000", 2023-01-25T09:20:07.898 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_standby_modules": "true", 2023-01-25T09:20:07.898 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_stats_period": "5", 2023-01-25T09:20:07.898 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_stats_threshold": "5", 2023-01-25T09:20:07.898 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_tick_period": "2", 2023-01-25T09:20:07.899 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-01-25T09:20:07.899 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_accept_timeout_factor": "2.000000", 2023-01-25T09:20:07.899 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_allow_pool_delete": "true", 2023-01-25T09:20:07.899 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_allow_pool_size_one": "true", 2023-01-25T09:20:07.899 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_auth_validate_all_caps": "true", 2023-01-25T09:20:07.900 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-01-25T09:20:07.900 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-01-25T09:20:07.900 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_bytes": "104857600", 2023-01-25T09:20:07.900 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_directed_command_retry": "5", 2023-01-25T09:20:07.900 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval": "3.000000", 2023-01-25T09:20:07.901 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-01-25T09:20:07.901 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-01-25T09:20:07.901 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-01-25T09:20:07.901 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_parallel": "3", 2023-01-25T09:20:07.901 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_log_interval": "1.000000", 2023-01-25T09:20:07.902 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-01-25T09:20:07.902 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_ping_interval": "10.000000", 2023-01-25T09:20:07.902 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_ping_timeout": "30.000000", 2023-01-25T09:20:07.902 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clock_drift_allowed": "1.000000", 2023-01-25T09:20:07.902 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-01-25T09:20:07.903 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-01-25T09:20:07.903 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_file_level": "debug", 2023-01-25T09:20:07.903 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_file": "true", 2023-01-25T09:20:07.903 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog": "false", 2023-01-25T09:20:07.903 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-01-25T09:20:07.904 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-01-25T09:20:07.904 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_journald": "false", 2023-01-25T09:20:07.904 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_stderr": "false", 2023-01-25T09:20:07.904 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-01-25T09:20:07.904 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-01-25T09:20:07.905 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-01-25T09:20:07.905 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_bootstrap": "false", 2023-01-25T09:20:07.905 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_start": "false", 2023-01-25T09:20:07.905 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_trim": "true", 2023-01-25T09:20:07.905 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_con_tracker_persist_interval": "10", 2023-01-25T09:20:07.906 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_con_tracker_score_halflife": "43200", 2023-01-25T09:20:07.906 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_config_key_max_entry_size": "65536", 2023-01-25T09:20:07.906 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cpu_threads": "4", 2023-01-25T09:20:07.906 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_crush_min_required_version": "hammer", 2023-01-25T09:20:07.906 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_daemon_bytes": "419430400", 2023-01-25T09:20:07.907 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-01-25T09:20:07.907 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_avail_crit": "5", 2023-01-25T09:20:07.907 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_avail_warn": "5", 2023-01-25T09:20:07.907 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_size_warn": "16106127360", 2023-01-25T09:20:07.907 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_block_osdmap_trim": "false", 2023-01-25T09:20:07.908 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-01-25T09:20:07.908 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_json": "false", 2023-01-25T09:20:07.908 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-01-25T09:20:07.908 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_transactions": "false", 2023-01-25T09:20:07.908 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_extra_checks": "false", 2023-01-25T09:20:07.909 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-01-25T09:20:07.909 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-01-25T09:20:07.909 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_quincy": "false", 2023-01-25T09:20:07.909 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_reef": "false", 2023-01-25T09:20:07.909 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-01-25T09:20:07.910 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_delta_reset_interval": "10.000000", 2023-01-25T09:20:07.910 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_dns_srv_name": "ceph-mon", 2023-01-25T09:20:07.910 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_down_mkfs_grace": "120", 2023-01-25T09:20:07.910 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_election_default_strategy": "3", 2023-01-25T09:20:07.910 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_election_timeout": "5.000000", 2023-01-25T09:20:07.911 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-01-25T09:20:07.911 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ping_divisor": "2", 2023-01-25T09:20:07.911 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ping_timeout": "2.000000", 2023-01-25T09:20:07.911 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_enable_op_tracker": "true", 2023-01-25T09:20:07.911 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_fake_pool_delete": "false", 2023-01-25T09:20:07.912 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_force_quorum_join": "false", 2023-01-25T09:20:07.912 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_globalid_prealloc": "10000", 2023-01-25T09:20:07.912 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_detail_to_clog": "false", 2023-01-25T09:20:07.912 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_log_update_period": "5", 2023-01-25T09:20:07.912 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_max_detail": "50", 2023-01-25T09:20:07.913 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog": "true", 2023-01-25T09:20:07.913 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog_interval": "600", 2023-01-25T09:20:07.913 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-01-25T09:20:07.913 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_host": "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.106", 2023-01-25T09:20:07.913 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_host_override": "", 2023-01-25T09:20:07.914 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_initial_members": "", 2023-01-25T09:20:07.914 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-01-25T09:20:07.914 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-01-25T09:20:07.914 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-01-25T09:20:07.914 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-01-25T09:20:07.915 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_keyvaluedb": "rocksdb", 2023-01-25T09:20:07.915 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease": "5.000000", 2023-01-25T09:20:07.915 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-01-25T09:20:07.915 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-01-25T09:20:07.915 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_full_interval": "50", 2023-01-25T09:20:07.916 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_max": "10000", 2023-01-25T09:20:07.916 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_max_summary": "50", 2023-01-25T09:20:07.916 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_log_entries_per_event": "4096", 2023-01-25T09:20:07.916 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_log_epochs": "500", 2023-01-25T09:20:07.916 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_mdsmap_epochs": "500", 2023-01-25T09:20:07.917 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_mgrmap_epochs": "500", 2023-01-25T09:20:07.917 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_osd": "10000", 2023-01-25T09:20:07.917 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_pg_per_osd": "10000", 2023-01-25T09:20:07.917 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_pool_pg_num": "65536", 2023-01-25T09:20:07.917 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-01-25T09:20:07.918 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-01-25T09:20:07.918 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_force_trim_to": "0", 2023-01-25T09:20:07.918 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_skip_sanity": "false", 2023-01-25T09:20:07.918 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_memory_autotune": "true", 2023-01-25T09:20:07.918 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_memory_target": "2147483648", 2023-01-25T09:20:07.919 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_beacon_grace": "30", 2023-01-25T09:20:07.919 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-01-25T09:20:07.919 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_digest_period": "5", 2023-01-25T09:20:07.919 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_inactive_grace": "60", 2023-01-25T09:20:07.919 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_mkfs_grace": "240", 2023-01-25T09:20:07.920 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-01-25T09:20:07.920 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_min_osdmap_epochs": "50", 2023-01-25T09:20:07.920 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_complaint_time": "30", 2023-01-25T09:20:07.920 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_duration": "600", 2023-01-25T09:20:07.920 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_size": "20", 2023-01-25T09:20:07.921 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_slow_op_size": "20", 2023-01-25T09:20:07.921 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_slow_op_threshold": "10", 2023-01-25T09:20:07.921 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_log_threshold": "5", 2023-01-25T09:20:07.921 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-01-25T09:20:07.921 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-01-25T09:20:07.922 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-01-25T09:20:07.922 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_in": "false", 2023-01-25T09:20:07.922 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_new_in": "true", 2023-01-25T09:20:07.922 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-01-25T09:20:07.922 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-01-25T09:20:07.923 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_cache_size": "500", 2023-01-25T09:20:07.923 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_cache_size_min": "134217728", 2023-01-25T09:20:07.923 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_crush_smoke_test": "true", 2023-01-25T09:20:07.923 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_destroyed_out_interval": "600", 2023-01-25T09:20:07.923 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_down_out_interval": "600", 2023-01-25T09:20:07.924 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-01-25T09:20:07.924 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-01-25T09:20:07.924 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_force_trim_to": "0", 2023-01-25T09:20:07.924 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_full_ratio": "0.950000", 2023-01-25T09:20:07.924 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-01-25T09:20:07.925 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_halflife": "3600", 2023-01-25T09:20:07.925 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_max_interval": "300", 2023-01-25T09:20:07.925 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_weight": "0.300000", 2023-01-25T09:20:07.925 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-01-25T09:20:07.925 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_max_creating_pgs": "1024", 2023-01-25T09:20:07.926 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_max_initial_pgs": "1024", 2023-01-25T09:20:07.926 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_down_reporters": "2", 2023-01-25T09:20:07.926 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-01-25T09:20:07.926 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-01-25T09:20:07.926 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-01-25T09:20:07.927 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp": "true", 2023-01-25T09:20:07.927 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-01-25T09:20:07.927 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-01-25T09:20:07.927 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_report_timeout": "900", 2023-01-25T09:20:07.927 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-01-25T09:20:07.928 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-01-25T09:20:07.928 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_warn_num_repaired": "10", 2023-01-25T09:20:07.928 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_warn_op_age": "32.000000", 2023-01-25T09:20:07.928 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-01-25T09:20:07.928 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_interval": "2", 2023-01-25T09:20:07.929 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_min": "15", 2023-01-25T09:20:07.929 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_txsize": "2", 2023-01-25T09:20:07.929 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-01-25T09:20:07.929 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_stuck_threshold": "60", 2023-01-25T09:20:07.929 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-01-25T09:20:07.930 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_objects": "10000", 2023-01-25T09:20:07.930 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_per_osd": "0", 2023-01-25T09:20:07.930 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-01-25T09:20:07.930 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pool_quota_crit_threshold": "0", 2023-01-25T09:20:07.930 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pool_quota_warn_threshold": "0", 2023-01-25T09:20:07.931 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_probe_timeout": "2.000000", 2023-01-25T09:20:07.931 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_max_change": "0.050000", 2023-01-25T09:20:07.931 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_max_osds": "4", 2023-01-25T09:20:07.931 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-01-25T09:20:07.931 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-01-25T09:20:07.932 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-01-25T09:20:07.932 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-01-25T09:20:07.932 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-01-25T09:20:07.932 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_interval": "300", 2023-01-25T09:20:07.932 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_max_keys": "100", 2023-01-25T09:20:07.933 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_timeout": "300", 2023-01-25T09:20:07.933 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_session_timeout": "300", 2023-01-25T09:20:07.933 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_smart_report_timeout": "5", 2023-01-25T09:20:07.933 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stat_smooth_intervals": "6", 2023-01-25T09:20:07.933 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-01-25T09:20:07.934 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_pool_min_size": "2", 2023-01-25T09:20:07.934 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_pool_size": "4", 2023-01-25T09:20:07.934 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-01-25T09:20:07.934 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_subscribe_interval": "86400.000000", 2023-01-25T09:20:07.934 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_debug": "false", 2023-01-25T09:20:07.935 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_max_payload_keys": "2000", 2023-01-25T09:20:07.935 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_max_payload_size": "1048576", 2023-01-25T09:20:07.935 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_provider_kill_at": "0", 2023-01-25T09:20:07.935 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_requester_kill_at": "0", 2023-01-25T09:20:07.935 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_timeout": "60.000000", 2023-01-25T09:20:07.936 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_target_pg_per_osd": "100", 2023-01-25T09:20:07.936 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_tick_interval": "5", 2023-01-25T09:20:07.936 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_timecheck_interval": "300.000000", 2023-01-25T09:20:07.936 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-01-25T09:20:07.936 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_use_min_delay_socket": "false", 2023-01-25T09:20:07.937 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_older_version_delay": "604800", 2023-01-25T09:20:07.937 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-01-25T09:20:07.937 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-01-25T09:20:07.937 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-01-25T09:20:07.937 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_filestore_osds": "false", 2023-01-25T09:20:07.938 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-01-25T09:20:07.938 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-01-25T09:20:07.938 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-01-25T09:20:07.938 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_misplaced": "false", 2023-01-25T09:20:07.938 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-01-25T09:20:07.939 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_older_version": "true", 2023-01-25T09:20:07.939 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-01-25T09:20:07.939 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_no_app": "true", 2023-01-25T09:20:07.939 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-01-25T09:20:07.939 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-01-25T09:20:07.940 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-01-25T09:20:07.940 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-01-25T09:20:07.940 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_too_few_osds": "false", 2023-01-25T09:20:07.940 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-01-25T09:20:07.940 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-01-25T09:20:07.941 INFO:teuthology.orchestra.run.smithi019.stdout: "monmap": "", 2023-01-25T09:20:07.941 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-01-25T09:20:07.941 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-01-25T09:20:07.941 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-01-25T09:20:07.941 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-01-25T09:20:07.942 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_tracing_enabled": "false", 2023-01-25T09:20:07.942 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_op_threads": "3", 2023-01-25T09:20:07.942 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_buffer_size": "131072", 2023-01-25T09:20:07.942 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_cm": "false", 2023-01-25T09:20:07.942 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_device_name": "", 2023-01-25T09:20:07.943 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_dscp": "96", 2023-01-25T09:20:07.943 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-01-25T09:20:07.943 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_gid_idx": "0", 2023-01-25T09:20:07.943 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_local_gid": "", 2023-01-25T09:20:07.943 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_polling_us": "1000", 2023-01-25T09:20:07.944 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_port_num": "1", 2023-01-25T09:20:07.944 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-01-25T09:20:07.944 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-01-25T09:20:07.944 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_roce_ver": "1", 2023-01-25T09:20:07.944 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_send_buffers": "1024", 2023-01-25T09:20:07.945 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_sl": "3", 2023-01-25T09:20:07.945 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_support_srq": "true", 2023-01-25T09:20:07.945 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_type": "ib", 2023-01-25T09:20:07.945 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_reap_threshold": "5", 2023-01-25T09:20:07.945 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_before_connect": "false", 2023-01-25T09:20:07.946 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_ipv4": "true", 2023-01-25T09:20:07.946 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_ipv6": "false", 2023-01-25T09:20:07.946 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_msgr1": "false", 2023-01-25T09:20:07.946 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_msgr2": "true", 2023-01-25T09:20:07.946 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_port_max": "7568", 2023-01-25T09:20:07.947 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_port_min": "6800", 2023-01-25T09:20:07.947 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_prefer_ipv4": "false", 2023-01-25T09:20:07.947 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_retry_count": "3", 2023-01-25T09:20:07.947 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_retry_delay": "5", 2023-01-25T09:20:07.947 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_client": "false", 2023-01-25T09:20:07.948 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mds": "false", 2023-01-25T09:20:07.948 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mgr": "false", 2023-01-25T09:20:07.948 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mon": "false", 2023-01-25T09:20:07.948 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_osd": "false", 2023-01-25T09:20:07.949 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_client_mode": "crc secure", 2023-01-25T09:20:07.949 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_cluster_mode": "crc secure", 2023-01-25T09:20:07.949 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_cluster_type": "", 2023-01-25T09:20:07.949 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_compress_secure": "false", 2023-01-25T09:20:07.949 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_connection_idle_timeout": "900", 2023-01-25T09:20:07.950 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_connection_ready_timeout": "10", 2023-01-25T09:20:07.950 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_crc_data": "true", 2023-01-25T09:20:07.950 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_crc_header": "true", 2023-01-25T09:20:07.950 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_bad_msg": "false", 2023-01-25T09:20:07.950 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_bug": "true", 2023-01-25T09:20:07.951 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_old_message": "true", 2023-01-25T09:20:07.951 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_skipped_message": "false", 2023-01-25T09:20:07.951 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_unhandled_msg": "false", 2023-01-25T09:20:07.951 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-01-25T09:20:07.951 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_coremask": "0xF", 2023-01-25T09:20:07.952 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-01-25T09:20:07.952 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_devs_allowlist": "", 2023-01-25T09:20:07.952 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_enable_tso": "true", 2023-01-25T09:20:07.952 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-01-25T09:20:07.952 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-01-25T09:20:07.953 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hugepages": "", 2023-01-25T09:20:07.953 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hw_flow_control": "true", 2023-01-25T09:20:07.953 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-01-25T09:20:07.953 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_lro": "true", 2023-01-25T09:20:07.953 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_memory_channel": "4", 2023-01-25T09:20:07.954 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-01-25T09:20:07.954 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_pmd": "", 2023-01-25T09:20:07.954 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_port_id": "0", 2023-01-25T09:20:07.954 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-01-25T09:20:07.954 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dump_corrupt_message_level": "1", 2023-01-25T09:20:07.954 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dump_on_send": "false", 2023-01-25T09:20:07.955 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_initial_backoff": "0.200000", 2023-01-25T09:20:07.955 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_max": "1.000000", 2023-01-25T09:20:07.955 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_probability": "0.005000", 2023-01-25T09:20:07.955 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_type": "osd", 2023-01-25T09:20:07.955 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_internal_delays": "0.002000", 2023-01-25T09:20:07.956 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_network_congestion": "0", 2023-01-25T09:20:07.956 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_socket_failures": "2500", 2023-01-25T09:20:07.956 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_learn_addr_from_peer": "true", 2023-01-25T09:20:07.956 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_max_accept_failures": "4", 2023-01-25T09:20:07.956 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_max_backoff": "15.000000", 2023-01-25T09:20:07.957 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_client_mode": "secure crc", 2023-01-25T09:20:07.957 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_cluster_mode": "secure crc", 2023-01-25T09:20:07.957 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_service_mode": "secure crc", 2023-01-25T09:20:07.957 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compress_min_size": "1024", 2023-01-25T09:20:07.957 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compress_mode": "none", 2023-01-25T09:20:07.958 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compression_algorithm": "snappy zlib zstd lz4", 2023-01-25T09:20:07.958 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-01-25T09:20:07.958 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_pq_min_cost": "65536", 2023-01-25T09:20:07.958 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_public_type": "", 2023-01-25T09:20:07.958 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_service_mode": "crc secure", 2023-01-25T09:20:07.959 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_listen_backlog": "512", 2023-01-25T09:20:07.959 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_nodelay": "true", 2023-01-25T09:20:07.959 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-01-25T09:20:07.959 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_rcvbuf": "0", 2023-01-25T09:20:07.960 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_type": "async", 2023-01-25T09:20:07.960 INFO:teuthology.orchestra.run.smithi019.stdout: "no_config_file": "false", 2023-01-25T09:20:07.960 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_completion_locks_per_session": "32", 2023-01-25T09:20:07.960 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_debug_inject_relock_delay": "false", 2023-01-25T09:20:07.960 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inflight_op_bytes": "104857600", 2023-01-25T09:20:07.961 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inflight_ops": "1024", 2023-01-25T09:20:07.961 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inject_no_watch_ping": "false", 2023-01-25T09:20:07.961 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-01-25T09:20:07.961 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_tick_interval": "5.000000", 2023-01-25T09:20:07.961 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_timeout": "10.000000", 2023-01-25T09:20:07.962 INFO:teuthology.orchestra.run.smithi019.stdout: "objectstore_blackhole": "false", 2023-01-25T09:20:07.962 INFO:teuthology.orchestra.run.smithi019.stdout: "openssl_engine_opts": "", 2023-01-25T09:20:07.962 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_delay_time": "5.000000", 2023-01-25T09:20:07.962 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_hist_halflife": "1000", 2023-01-25T09:20:07.962 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_max_low_ops": "2", 2023-01-25T09:20:07.962 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_max_ops": "4", 2023-01-25T09:20:07.963 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-01-25T09:20:07.963 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_quantize_effort": "0.100000", 2023-01-25T09:20:07.963 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_slop": "0.020000", 2023-01-25T09:20:07.963 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-01-25T09:20:07.963 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_allow_recovery_below_min_size": "true", 2023-01-25T09:20:07.964 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_asio_thread_count": "2", 2023-01-25T09:20:07.964 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_async_recovery_min_cost": "100", 2023-01-25T09:20:07.964 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_auto_mark_unfound_lost": "false", 2023-01-25T09:20:07.964 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_retry_interval": "30.000000", 2023-01-25T09:20:07.964 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_scan_max": "512", 2023-01-25T09:20:07.965 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_scan_min": "64", 2023-01-25T09:20:07.965 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_degraded": "false", 2023-01-25T09:20:07.965 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_peering": "false", 2023-01-25T09:20:07.965 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_unfound": "true", 2023-01-25T09:20:07.965 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_beacon_report_interval": "300", 2023-01-25T09:20:07.966 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_duration": "30", 2023-01-25T09:20:07.966 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-01-25T09:20:07.966 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_max_block_size": "67108864", 2023-01-25T09:20:07.966 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_small_size_max_iops": "100", 2023-01-25T09:20:07.966 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_blkin_trace_all": "false", 2023-01-25T09:20:07.967 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_blocked_scrub_grace_period": "120", 2023-01-25T09:20:07.967 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-01-25T09:20:07.967 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-01-25T09:20:07.967 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-01-25T09:20:07.967 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_check_for_log_corruption": "false", 2023-01-25T09:20:07.968 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-01-25T09:20:07.968 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-01-25T09:20:07.968 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2023-01-25T09:20:07.968 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-01-25T09:20:07.968 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_update_on_start": "true", 2023-01-25T09:20:07.969 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_message_cap": "256", 2023-01-25T09:20:07.969 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_message_size_cap": "524288000", 2023-01-25T09:20:07.969 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_op_priority": "63", 2023-01-25T09:20:07.969 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_watch_timeout": "30", 2023-01-25T09:20:07.969 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_command_max_records": "256", 2023-01-25T09:20:07.970 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_compact_on_start": "false", 2023-01-25T09:20:07.970 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-01-25T09:20:07.970 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_chooseleaf_type": "0", 2023-01-25T09:20:07.970 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_initial_weight": "-1.000000", 2023-01-25T09:20:07.970 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_update_on_start": "true", 2023-01-25T09:20:07.970 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_update_weight_set": "true", 2023-01-25T09:20:07.971 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-01-25T09:20:07.971 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-01-25T09:20:07.971 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-01-25T09:20:07.971 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_drop_ping_duration": "0", 2023-01-25T09:20:07.972 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-01-25T09:20:07.972 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_feed_pullee": "-1", 2023-01-25T09:20:07.972 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-01-25T09:20:07.972 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-01-25T09:20:07.972 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-01-25T09:20:07.973 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_misdirected_ops": "false", 2023-01-25T09:20:07.973 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_no_acting_change": "false", 2023-01-25T09:20:07.973 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_no_purge_strays": "false", 2023-01-25T09:20:07.973 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_op_order": "false", 2023-01-25T09:20:07.973 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_pg_log_writeout": "false", 2023-01-25T09:20:07.974 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_pretend_recovery_active": "false", 2023-01-25T09:20:07.974 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-01-25T09:20:07.974 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-01-25T09:20:07.974 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_shutdown": "false", 2023-01-25T09:20:07.974 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-01-25T09:20:07.974 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-01-25T09:20:07.975 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_cached_snaps": "false", 2023-01-25T09:20:07.975 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_missing_on_start": "false", 2023-01-25T09:20:07.975 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_snaps": "false", 2023-01-25T09:20:07.975 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-01-25T09:20:07.975 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-01-25T09:20:07.976 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_keys": "1024", 2023-01-25T09:20:07.976 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-01-25T09:20:07.976 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-01-25T09:20:07.976 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-01-25T09:20:07.977 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_stride": "524288", 2023-01-25T09:20:07.977 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-01-25T09:20:07.977 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_default_data_pool_replay_window": "5", 2023-01-25T09:20:07.977 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_default_notify_timeout": "30", 2023-01-25T09:20:07.977 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep": "0.000000", 2023-01-25T09:20:07.978 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-01-25T09:20:07.978 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-01-25T09:20:07.978 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-01-25T09:20:07.978 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_discard_disconnected_ops": "true", 2023-01-25T09:20:07.978 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_enable_op_tracker": "true", 2023-01-25T09:20:07.979 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-01-25T09:20:07.979 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_extblkdev_plugins": "vdo", 2023-01-25T09:20:07.979 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-01-25T09:20:07.979 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-01-25T09:20:07.979 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_info": "true", 2023-01-25T09:20:07.980 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown": "true", 2023-01-25T09:20:07.980 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-01-25T09:20:07.980 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown_timeout": "15", 2023-01-25T09:20:07.980 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-01-25T09:20:07.980 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-01-25T09:20:07.981 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-01-25T09:20:07.981 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_function_tracing": "false", 2023-01-25T09:20:07.981 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_grace": "20", 2023-01-25T09:20:07.981 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_interval": "6", 2023-01-25T09:20:07.981 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-01-25T09:20:07.982 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_peers": "10", 2023-01-25T09:20:07.982 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_size": "2000", 2023-01-25T09:20:07.982 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_stale": "600", 2023-01-25T09:20:07.982 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-01-25T09:20:07.982 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_max_size": "100000", 2023-01-25T09:20:07.982 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_min_size": "1000", 2023-01-25T09:20:07.983 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-01-25T09:20:07.983 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-01-25T09:20:07.983 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-01-25T09:20:07.983 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-01-25T09:20:07.984 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-01-25T09:20:07.984 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal_flush_on_shutdown": "true", 2023-01-25T09:20:07.984 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal_size": "5120", 2023-01-25T09:20:07.984 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_kill_backfill_at": "0", 2023-01-25T09:20:07.984 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_loop_before_reset_tphandle": "64", 2023-01-25T09:20:07.985 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_cache_size": "50", 2023-01-25T09:20:07.985 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_dedup": "true", 2023-01-25T09:20:07.985 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_message_max": "40", 2023-01-25T09:20:07.985 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_message_max_bytes": "10485760", 2023-01-25T09:20:07.985 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_share_max_epochs": "40", 2023-01-25T09:20:07.986 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_attr_name_len": "100", 2023-01-25T09:20:07.986 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_attr_size": "0", 2023-01-25T09:20:07.986 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_backfills": "1", 2023-01-25T09:20:07.986 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_markdown_count": "5", 2023-01-25T09:20:07.986 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_markdown_period": "600", 2023-01-25T09:20:07.987 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_name_len": "2048", 2023-01-25T09:20:07.987 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_namespace_len": "256", 2023-01-25T09:20:07.987 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_size": "134217728", 2023-01-25T09:20:07.987 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-01-25T09:20:07.987 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_omap_entries_per_request": "1024", 2023-01-25T09:20:07.988 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_blocked_by": "16", 2023-01-25T09:20:07.988 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_log_entries": "2", 2023-01-25T09:20:07.988 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-01-25T09:20:07.988 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pgls": "1024", 2023-01-25T09:20:07.988 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_push_cost": "8388608", 2023-01-25T09:20:07.989 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_push_objects": "10", 2023-01-25T09:20:07.989 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_scrubs": "1", 2023-01-25T09:20:07.989 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-01-25T09:20:07.989 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_trimming_pgs": "2", 2023-01-25T09:20:07.989 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_write_op_reply_len": "64", 2023-01-25T09:20:07.990 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_write_size": "90", 2023-01-25T09:20:07.990 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_cost_per_byte_usec": "0.000000", 2023-01-25T09:20:07.990 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_cost_per_byte_usec_hdd": "2.600000", 2023-01-25T09:20:07.990 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_cost_per_byte_usec_ssd": "0.011000", 2023-01-25T09:20:07.990 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_cost_per_io_usec": "0.000000", 2023-01-25T09:20:07.991 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_cost_per_io_usec_hdd": "11400.000000", 2023-01-25T09:20:07.991 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_cost_per_io_usec_ssd": "50.000000", 2023-01-25T09:20:07.991 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-01-25T09:20:07.991 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-01-25T09:20:07.991 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-01-25T09:20:07.992 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-01-25T09:20:07.992 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-01-25T09:20:07.992 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_override_recovery_settings": "false", 2023-01-25T09:20:07.992 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_profile": "high_client_ops", 2023-01-25T09:20:07.992 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-01-25T09:20:07.993 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2023-01-25T09:20:07.993 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2023-01-25T09:20:07.993 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-01-25T09:20:07.993 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2023-01-25T09:20:07.993 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2023-01-25T09:20:07.994 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-01-25T09:20:07.994 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_lim": "999999", 2023-01-25T09:20:07.994 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_res": "1", 2023-01-25T09:20:07.994 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-01-25T09:20:07.994 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_skip_benchmark": "false", 2023-01-25T09:20:07.995 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_base": "805306368", 2023-01-25T09:20:07.995 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_cache_min": "134217728", 2023-01-25T09:20:07.995 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-01-25T09:20:07.995 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-01-25T09:20:07.995 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target": "4294967296", 2023-01-25T09:20:07.996 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target_autotune": "false", 2023-01-25T09:20:07.996 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-01-25T09:20:07.996 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_min_pg_log_entries": "1", 2023-01-25T09:20:07.996 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_min_recovery_priority": "0", 2023-01-25T09:20:07.996 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_heartbeat_interval": "30", 2023-01-25T09:20:07.997 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-01-25T09:20:07.997 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_report_interval": "5", 2023-01-25T09:20:07.997 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_report_max_in_flight": "2", 2023-01-25T09:20:07.997 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-01-25T09:20:07.997 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_num_cache_shards": "32", 2023-01-25T09:20:07.998 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_num_op_tracker_shard": "32", 2023-01-25T09:20:07.998 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_auto_affinity": "true", 2023-01-25T09:20:07.998 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_node": "-1", 2023-01-25T09:20:07.998 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_prefer_iface": "true", 2023-01-25T09:20:07.998 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-01-25T09:20:07.999 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objecter_finishers": "1", 2023-01-25T09:20:07.999 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore": "bluestore", 2023-01-25T09:20:07.999 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_fuse": "false", 2023-01-25T09:20:07.999 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_tracing": "false", 2023-01-25T09:20:07.999 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_complaint_time": "30.000000", 2023-01-25T09:20:08.000 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_duration": "600", 2023-01-25T09:20:08.000 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_size": "20", 2023-01-25T09:20:08.000 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_slow_op_size": "20", 2023-01-25T09:20:08.000 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-01-25T09:20:08.000 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_log_threshold": "5", 2023-01-25T09:20:08.001 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards": "0", 2023-01-25T09:20:08.001 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards_hdd": "5", 2023-01-25T09:20:08.001 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards_ssd": "8", 2023-01-25T09:20:08.001 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard": "0", 2023-01-25T09:20:08.001 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-01-25T09:20:08.002 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-01-25T09:20:08.002 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-01-25T09:20:08.002 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_pq_min_cost": "65536", 2023-01-25T09:20:08.002 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_queue": "mclock_scheduler", 2023-01-25T09:20:08.002 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_queue_cut_off": "high", 2023-01-25T09:20:08.003 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_thread_suicide_timeout": "150", 2023-01-25T09:20:08.003 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_thread_timeout": "15", 2023-01-25T09:20:08.003 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_open_classes_on_start": "true", 2023-01-25T09:20:08.003 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_os_flags": "0", 2023-01-25T09:20:08.003 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_peering_op_priority": "255", 2023-01-25T09:20:08.003 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_delete_cost": "1048576", 2023-01-25T09:20:08.004 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_delete_priority": "5", 2023-01-25T09:20:08.004 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-01-25T09:20:08.004 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-01-25T09:20:08.004 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_dups_tracked": "3000", 2023-01-25T09:20:08.004 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_trim_max": "10000", 2023-01-25T09:20:08.005 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_trim_min": "0", 2023-01-25T09:20:08.005 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-01-25T09:20:08.005 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_object_context_cache_count": "64", 2023-01-25T09:20:08.005 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_stat_report_interval_max": "500", 2023-01-25T09:20:08.005 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-01-25T09:20:08.006 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-01-25T09:20:08.006 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-01-25T09:20:08.006 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-01-25T09:20:08.006 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-01-25T09:20:08.006 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-01-25T09:20:08.007 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_crush_rule": "-1", 2023-01-25T09:20:08.007 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_ec_fast_read": "false", 2023-01-25T09:20:08.007 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-01-25T09:20:08.007 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_bulk": "false", 2023-01-25T09:20:08.007 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-01-25T09:20:08.007 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nodelete": "false", 2023-01-25T09:20:08.008 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-01-25T09:20:08.008 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-01-25T09:20:08.008 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flags": "0", 2023-01-25T09:20:08.008 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-01-25T09:20:08.009 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_min_size": "2", 2023-01-25T09:20:08.009 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-01-25T09:20:08.009 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pg_num": "32", 2023-01-25T09:20:08.009 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pgp_num": "0", 2023-01-25T09:20:08.009 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-01-25T09:20:08.009 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_size": "3", 2023-01-25T09:20:08.010 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_type": "replicated", 2023-01-25T09:20:08.010 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-01-25T09:20:08.010 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_use_gmt_hitset": "true", 2023-01-25T09:20:08.010 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_push_per_object_cost": "1000", 2023-01-25T09:20:08.010 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_read_ec_check_for_errors": "false", 2023-01-25T09:20:08.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recover_clone_overlap": "true", 2023-01-25T09:20:08.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recover_clone_overlap_limit": "10", 2023-01-25T09:20:08.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_cost": "20971520", 2023-01-25T09:20:08.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_delay_start": "0.000000", 2023-01-25T09:20:08.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active": "10", 2023-01-25T09:20:08.012 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active_hdd": "3", 2023-01-25T09:20:08.012 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active_ssd": "10", 2023-01-25T09:20:08.012 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_chunk": "8388608", 2023-01-25T09:20:08.012 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-01-25T09:20:08.012 INFO:teuthology.orchestr