2023-01-25T12:12:35.560 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T12:12:35.561 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} --archive /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137413 -- /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137413/orig.config.yaml 2023-01-25T12:12:35.611 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T12:12:35.678 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137413 branch: wip-yuri6-testing-2023-01-24-0746 description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} email: yweinstein@radhat.com first_in_suite: false job_id: '7137413' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri6-testing-2023-01-24-0746 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd_async_recovery_min_cost: 1 osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd inject bad map crc probability: 0.1 osd max backfills: 3 osd max markdown count: 1000 osd mclock override recovery settings: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - must scrub before tier agent can activate mon_bind_msgr2: false sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2023-01-24-0746 sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri6-testing-2023-01-24-0746 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c targets: smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - thrashosds: aggressive_pg_num_changes: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 timeout: 1200 - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - sudo ceph osd pool set cache min_read_recency_for_promote 2 - sudo ceph osd pool set cache min_write_recency_for_promote 2 - rados: clients: - client.0 objects: 500 op_weights: copy_from: 50 delete: 50 read: 100 write: 100 ops: 4000 pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:27:30 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T12:12:35.678 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa; will attempt to use it 2023-01-25T12:12:35.679 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa/tasks 2023-01-25T12:12:35.679 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T12:12:35.681 INFO:teuthology.task.internal:Checking packages... 2023-01-25T12:12:35.707 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '44e4095da12a8269eb6cfe163cbb0d00b1a6412c' 2023-01-25T12:12:35.708 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T12:12:35.708 INFO:teuthology.packaging:ref: None 2023-01-25T12:12:35.709 INFO:teuthology.packaging:tag: None 2023-01-25T12:12:35.709 INFO:teuthology.packaging:branch: wip-yuri6-testing-2023-01-24-0746 2023-01-25T12:12:35.709 INFO:teuthology.packaging:sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T12:12:35.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri6-testing-2023-01-24-0746 2023-01-25T12:12:35.858 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1986-g44e4095d-1focal 2023-01-25T12:12:35.858 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T12:12:35.865 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T12:12:35.865 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T12:12:35.902 INFO:teuthology.task.internal:Saving configuration 2023-01-25T12:12:35.922 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T12:12:35.933 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T12:12:35.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137413', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 12:06:31.091451', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-01-25T12:12:35.979 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137413', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 12:06:31.090106', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-01-25T12:12:35.979 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T12:12:35.986 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-25T12:12:35.986 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-25T12:12:35.987 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T12:12:36.068 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa937b9e5e0>, signals=[15]) 2023-01-25T12:12:36.070 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T12:12:36.077 INFO:teuthology.task.internal:Opening connections... 2023-01-25T12:12:36.077 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2023-01-25T12:12:36.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T12:12:36.133 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2023-01-25T12:12:36.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T12:12:36.185 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T12:12:36.192 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-01-25T12:12:36.212 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-01-25T12:12:36.212 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-01-25T12:12:36.260 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2023-01-25T12:12:36.260 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-25T12:12:36.261 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2023-01-25T12:12:36.261 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2023-01-25T12:12:36.261 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-25T12:12:36.261 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="20.04" 2023-01-25T12:12:36.262 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-25T12:12:36.262 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-25T12:12:36.262 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-25T12:12:36.262 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-25T12:12:36.262 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=focal 2023-01-25T12:12:36.263 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=focal 2023-01-25T12:12:36.263 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-01-25T12:12:36.279 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-01-25T12:12:36.286 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-01-25T12:12:36.286 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-01-25T12:12:36.335 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2023-01-25T12:12:36.335 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-25T12:12:36.336 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2023-01-25T12:12:36.336 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2023-01-25T12:12:36.336 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-25T12:12:36.336 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="20.04" 2023-01-25T12:12:36.336 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-25T12:12:36.337 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-25T12:12:36.337 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-25T12:12:36.337 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-25T12:12:36.337 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=focal 2023-01-25T12:12:36.337 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=focal 2023-01-25T12:12:36.338 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-01-25T12:12:36.354 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T12:12:36.363 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T12:12:36.386 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T12:12:36.386 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2023-01-25T12:12:36.389 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2023-01-25T12:12:36.395 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T12:12:36.410 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T12:12:36.411 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2023-01-25T12:12:36.413 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2023-01-25T12:12:36.427 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T12:12:36.480 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T12:12:36.494 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T12:12:36.495 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T12:12:36.495 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T12:12:36.496 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T12:12:36.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:12:36.502 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2023-01-25T12:12:36.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:12:36.503 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-01-25T12:12:36.509 INFO:teuthology.orchestra.run.smithi117.stdout:5.4.0-124-generic 2023-01-25T12:12:36.510 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.4.0-124-generic 2023-01-25T12:12:36.510 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2023-01-25T12:12:36.511 INFO:teuthology.orchestra.run.smithi148.stdout:5.4.0-124-generic 2023-01-25T12:12:36.511 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.4.0-124-generic 2023-01-25T12:12:36.512 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get clean 2023-01-25T12:12:36.610 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2023-01-25T12:12:36.649 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2023-01-25T12:12:36.835 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T12:12:36.835 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-25T12:12:36.836 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-25T12:12:36.887 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-25T12:12:36.912 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T12:12:36.912 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-25T12:12:36.983 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-25T12:12:37.227 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [545 kB] 2023-01-25T12:12:37.301 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,961 kB] 2023-01-25T12:12:37.339 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [320 kB] 2023-01-25T12:12:37.341 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-25T12:12:37.341 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,463 kB] 2023-01-25T12:12:37.354 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [29.1 kB] 2023-01-25T12:12:37.355 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [207 kB] 2023-01-25T12:12:37.357 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,359 kB] 2023-01-25T12:12:37.357 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [624 B] 2023-01-25T12:12:37.357 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [576 kB] 2023-01-25T12:12:37.362 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [787 kB] 2023-01-25T12:12:37.367 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [152 kB] 2023-01-25T12:12:37.369 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-25T12:12:37.369 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-25T12:12:37.431 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,961 kB] 2023-01-25T12:12:37.457 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [780 kB] 2023-01-25T12:12:37.463 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [404 kB] 2023-01-25T12:12:37.466 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.2 kB] 2023-01-25T12:12:37.466 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,560 kB] 2023-01-25T12:12:37.476 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [30.4 kB] 2023-01-25T12:12:37.477 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [220 kB] 2023-01-25T12:12:37.479 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [620 B] 2023-01-25T12:12:37.479 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-25T12:12:37.483 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,019 kB] 2023-01-25T12:12:37.490 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [236 kB] 2023-01-25T12:12:37.492 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [23.4 kB] 2023-01-25T12:12:37.496 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-01-25T12:12:37.497 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-01-25T12:12:37.497 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [604 B] 2023-01-25T12:12:37.497 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-01-25T12:12:37.498 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-01-25T12:12:37.498 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-01-25T12:12:37.575 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [780 kB] 2023-01-25T12:12:37.939 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,359 kB] 2023-01-25T12:12:37.939 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [545 kB] 2023-01-25T12:12:37.955 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [320 kB] 2023-01-25T12:12:37.966 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-25T12:12:37.966 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,463 kB] 2023-01-25T12:12:38.038 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [29.1 kB] 2023-01-25T12:12:38.039 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [207 kB] 2023-01-25T12:12:38.046 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [624 B] 2023-01-25T12:12:38.046 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [787 kB] 2023-01-25T12:12:38.070 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [576 kB] 2023-01-25T12:12:38.087 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [152 kB] 2023-01-25T12:12:38.091 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-25T12:12:38.126 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [404 kB] 2023-01-25T12:12:38.140 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.2 kB] 2023-01-25T12:12:38.141 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,560 kB] 2023-01-25T12:12:38.196 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [30.4 kB] 2023-01-25T12:12:38.197 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [220 kB] 2023-01-25T12:12:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [620 B] 2023-01-25T12:12:38.204 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,019 kB] 2023-01-25T12:12:38.236 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-25T12:12:38.248 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [236 kB] 2023-01-25T12:12:38.254 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [23.4 kB] 2023-01-25T12:12:38.295 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-01-25T12:12:38.296 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-01-25T12:12:38.297 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [604 B] 2023-01-25T12:12:38.297 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-01-25T12:12:38.297 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-01-25T12:12:38.309 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-01-25T12:12:40.779 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 13.8 MB in 2s (6,644 kB/s) 2023-01-25T12:12:41.420 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 13.8 MB in 3s (5,099 kB/s) 2023-01-25T12:12:42.068 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-01-25T12:12:42.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T12:12:42.179 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-01-25T12:12:42.366 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2023-01-25T12:12:42.367 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2023-01-25T12:12:42.533 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2023-01-25T12:12:42.533 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T12:12:42.533 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-generic linux-image-5.4.0-137-generic 2023-01-25T12:12:42.533 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-5.4.0-137-generic linux-modules-extra-5.4.0-137-generic 2023-01-25T12:12:42.534 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2023-01-25T12:12:42.534 INFO:teuthology.orchestra.run.smithi117.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-01-25T12:12:42.534 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2023-01-25T12:12:42.535 INFO:teuthology.orchestra.run.smithi117.stdout: thermald 2023-01-25T12:12:42.591 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2023-01-25T12:12:42.592 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T12:12:42.592 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-137-generic linux-modules-5.4.0-137-generic 2023-01-25T12:12:42.592 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-extra-5.4.0-137-generic 2023-01-25T12:12:42.592 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2023-01-25T12:12:42.593 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-generic linux-image-generic 2023-01-25T12:12:42.793 INFO:teuthology.orchestra.run.smithi117.stdout:3 upgraded, 5 newly installed, 0 to remove and 133 not upgraded. 2023-01-25T12:12:42.794 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 77.1 MB of archives. 2023-01-25T12:12:42.794 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 380 MB of additional disk space will be used. 2023-01-25T12:12:42.794 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-137-generic amd64 5.4.0-137.154 [15.0 MB] 2023-01-25T12:12:42.870 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-01-25T12:12:42.896 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T12:12:42.965 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-01-25T12:12:43.151 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2023-01-25T12:12:43.152 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2023-01-25T12:12:43.317 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2023-01-25T12:12:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: linux-generic linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T12:12:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: linux-headers-generic linux-image-5.4.0-137-generic 2023-01-25T12:12:43.318 INFO:teuthology.orchestra.run.smithi148.stdout: linux-modules-5.4.0-137-generic linux-modules-extra-5.4.0-137-generic 2023-01-25T12:12:43.318 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2023-01-25T12:12:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-01-25T12:12:43.319 INFO:teuthology.orchestra.run.smithi148.stdout:Recommended packages: 2023-01-25T12:12:43.319 INFO:teuthology.orchestra.run.smithi148.stdout: thermald 2023-01-25T12:12:43.365 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2023-01-25T12:12:43.366 INFO:teuthology.orchestra.run.smithi148.stdout: linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T12:12:43.366 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-137-generic linux-modules-5.4.0-137-generic 2023-01-25T12:12:43.366 INFO:teuthology.orchestra.run.smithi148.stdout: linux-modules-extra-5.4.0-137-generic 2023-01-25T12:12:43.367 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages will be upgraded: 2023-01-25T12:12:43.368 INFO:teuthology.orchestra.run.smithi148.stdout: linux-generic linux-headers-generic linux-image-generic 2023-01-25T12:12:43.565 INFO:teuthology.orchestra.run.smithi148.stdout:3 upgraded, 5 newly installed, 0 to remove and 133 not upgraded. 2023-01-25T12:12:43.565 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 77.1 MB of archives. 2023-01-25T12:12:43.566 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 380 MB of additional disk space will be used. 2023-01-25T12:12:43.566 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-137-generic amd64 5.4.0-137.154 [15.0 MB] 2023-01-25T12:12:44.046 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-137-generic amd64 5.4.0-137.154 [10.5 MB] 2023-01-25T12:12:44.344 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-137-generic amd64 5.4.0-137.154 [39.2 MB] 2023-01-25T12:12:44.852 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-137-generic amd64 5.4.0-137.154 [10.5 MB] 2023-01-25T12:12:45.147 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-137-generic amd64 5.4.0-137.154 [39.2 MB] 2023-01-25T12:12:45.723 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.137.135 [1,896 B] 2023-01-25T12:12:45.723 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.137.135 [2,528 B] 2023-01-25T12:12:45.724 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137 all 5.4.0-137.154 [11.0 MB] 2023-01-25T12:12:46.079 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137-generic amd64 5.4.0-137.154 [1,400 kB] 2023-01-25T12:12:46.119 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.137.135 [2,392 B] 2023-01-25T12:12:46.598 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.137.135 [1,896 B] 2023-01-25T12:12:46.598 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.137.135 [2,528 B] 2023-01-25T12:12:46.599 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137 all 5.4.0-137.154 [11.0 MB] 2023-01-25T12:12:46.844 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 77.1 MB in 4s (21.9 MB/s) 2023-01-25T12:12:47.011 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-5.4.0-137-generic. 2023-01-25T12:12:47.113 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137-generic amd64 5.4.0-137.154 [1,400 kB] 2023-01-25T12:12:47.193 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.137.135 [2,392 B] 2023-01-25T12:12:47.895 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 77.1 MB in 4s (20.2 MB/s) 2023-01-25T12:12:48.090 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-modules-5.4.0-137-generic. 2023-01-25T12:12:48.749 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-01-25T12:12:48.754 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../0-linux-modules-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T12:12:48.875 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:12:49.795 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-01-25T12:12:49.800 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../0-linux-modules-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T12:12:49.929 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:12:50.841 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-image-5.4.0-137-generic. 2023-01-25T12:12:50.856 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../1-linux-image-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T12:12:50.952 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:12:51.863 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-image-5.4.0-137-generic. 2023-01-25T12:12:51.877 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../1-linux-image-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T12:12:51.982 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:12:51.985 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-137-generic. 2023-01-25T12:12:51.998 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T12:12:52.060 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:12:53.066 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-137-generic. 2023-01-25T12:12:53.079 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T12:12:53.141 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:12:57.072 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../3-linux-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T12:12:57.205 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T12:12:57.564 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T12:12:57.708 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T12:12:57.779 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../3-linux-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T12:12:57.903 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T12:12:58.061 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.4.0-137. 2023-01-25T12:12:58.078 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../5-linux-headers-5.4.0-137_5.4.0-137.154_all.deb ... 2023-01-25T12:12:58.119 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T12:12:58.261 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T12:12:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-image-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T12:12:58.734 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-headers-5.4.0-137. 2023-01-25T12:12:58.747 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../5-linux-headers-5.4.0-137_5.4.0-137.154_all.deb ... 2023-01-25T12:12:58.784 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T12:13:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.4.0-137-generic. 2023-01-25T12:13:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../6-linux-headers-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T12:13:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:04.730 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-headers-5.4.0-137-generic. 2023-01-25T12:13:04.752 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../6-linux-headers-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T12:13:04.796 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:06.527 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T12:13:06.649 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T12:13:06.990 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T12:13:07.137 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:07.573 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T12:13:07.701 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T12:13:08.052 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T12:13:08.198 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:08.381 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:08.507 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:09.441 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:09.567 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:09.942 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-137-generic 2023-01-25T12:13:09.942 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-137-generic 2023-01-25T12:13:10.575 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:10.722 INFO:teuthology.orchestra.run.smithi148.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-137-generic 2023-01-25T12:13:10.722 INFO:teuthology.orchestra.run.smithi148.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-137-generic 2023-01-25T12:13:11.636 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:11.819 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-generic (5.4.0.137.135) ... 2023-01-25T12:13:11.944 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-generic (5.4.0.137.135) ... 2023-01-25T12:13:12.070 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-generic (5.4.0.137.135) ... 2023-01-25T12:13:12.205 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:12.269 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-01-25T12:13:12.269 INFO:teuthology.orchestra.run.smithi117.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-137-generic 2023-01-25T12:13:12.813 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-image-generic (5.4.0.137.135) ... 2023-01-25T12:13:12.939 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-generic (5.4.0.137.135) ... 2023-01-25T12:13:13.123 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-generic (5.4.0.137.135) ... 2023-01-25T12:13:13.250 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T12:13:13.336 INFO:teuthology.orchestra.run.smithi148.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-01-25T12:13:13.336 INFO:teuthology.orchestra.run.smithi148.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-137-generic 2023-01-25T12:13:34.019 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-01-25T12:13:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub' 2023-01-25T12:13:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T12:13:34.058 INFO:teuthology.orchestra.run.smithi117.stdout:Generating grub configuration file ... 2023-01-25T12:13:34.424 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T12:13:34.443 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T12:13:34.845 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T12:13:34.856 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T12:13:35.127 INFO:teuthology.orchestra.run.smithi148.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-01-25T12:13:35.127 INFO:teuthology.orchestra.run.smithi148.stdout:Sourcing file `/etc/default/grub' 2023-01-25T12:13:35.145 INFO:teuthology.orchestra.run.smithi148.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T12:13:35.162 INFO:teuthology.orchestra.run.smithi148.stdout:Generating grub configuration file ... 2023-01-25T12:13:35.476 INFO:teuthology.orchestra.run.smithi148.stdout:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T12:13:35.498 INFO:teuthology.orchestra.run.smithi148.stdout:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T12:13:35.885 INFO:teuthology.orchestra.run.smithi148.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T12:13:35.897 INFO:teuthology.orchestra.run.smithi148.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T12:13:37.515 INFO:teuthology.orchestra.run.smithi117.stdout:done 2023-01-25T12:13:37.993 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2023-01-25T12:13:38.053 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2023-01-25T12:13:38.054 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2023-01-25T12:13:38.054 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2023-01-25T12:13:38.054 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2023-01-25T12:13:38.055 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 19 2023-01-25T12:13:38.055 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T12:13:38.055 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2023-01-25T12:13:38.055 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2023-01-25T12:13:38.055 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.4.0.137.135 2023-01-25T12:13:38.056 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T12:13:38.056 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T12:13:38.056 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2023-01-25T12:13:38.057 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2023-01-25T12:13:38.057 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2023-01-25T12:13:38.057 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2023-01-25T12:13:38.057 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-137-generic 2023-01-25T12:13:38.057 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T12:13:38.058 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T12:13:38.058 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-01-25T12:13:38.058 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T12:13:38.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2023-01-25T12:13:38.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2023-01-25T12:13:38.275 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T12:13:38.414 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T12:13:38.505 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T12:13:38.574 INFO:teuthology.orchestra.run.smithi148.stdout:done 2023-01-25T12:13:38.596 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T12:13:39.006 DEBUG:teuthology.orchestra.run.smithi148:> dpkg -s linux-image-generic 2023-01-25T12:13:39.075 INFO:teuthology.orchestra.run.smithi148.stdout:Package: linux-image-generic 2023-01-25T12:13:39.075 INFO:teuthology.orchestra.run.smithi148.stdout:Status: install ok installed 2023-01-25T12:13:39.075 INFO:teuthology.orchestra.run.smithi148.stdout:Priority: optional 2023-01-25T12:13:39.075 INFO:teuthology.orchestra.run.smithi148.stdout:Section: kernel 2023-01-25T12:13:39.076 INFO:teuthology.orchestra.run.smithi148.stdout:Installed-Size: 19 2023-01-25T12:13:39.076 INFO:teuthology.orchestra.run.smithi148.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T12:13:39.076 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: amd64 2023-01-25T12:13:39.076 INFO:teuthology.orchestra.run.smithi148.stdout:Source: linux-meta 2023-01-25T12:13:39.076 INFO:teuthology.orchestra.run.smithi148.stdout:Version: 5.4.0.137.135 2023-01-25T12:13:39.077 INFO:teuthology.orchestra.run.smithi148.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T12:13:39.077 INFO:teuthology.orchestra.run.smithi148.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T12:13:39.077 INFO:teuthology.orchestra.run.smithi148.stdout:Recommends: thermald 2023-01-25T12:13:39.077 INFO:teuthology.orchestra.run.smithi148.stdout:Description: Generic Linux kernel image 2023-01-25T12:13:39.077 INFO:teuthology.orchestra.run.smithi148.stdout: This package will always depend on the latest generic kernel image 2023-01-25T12:13:39.078 INFO:teuthology.orchestra.run.smithi148.stdout: available. 2023-01-25T12:13:39.078 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-137-generic 2023-01-25T12:13:39.078 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T12:13:39.078 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T12:13:39.079 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-01-25T12:13:39.079 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T12:13:39.079 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get clean 2023-01-25T12:13:39.157 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2023-01-25T12:13:39.307 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T12:13:39.424 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T12:13:39.515 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T12:13:39.606 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T12:13:39.931 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-01-25T12:13:39.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T12:13:40.024 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-01-25T12:13:40.188 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2023-01-25T12:13:40.189 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2023-01-25T12:13:40.381 INFO:teuthology.orchestra.run.smithi117.stdout:linux-image-generic is already the newest version (5.4.0.137.135). 2023-01-25T12:13:40.381 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 0 newly installed, 0 to remove and 133 not upgraded. 2023-01-25T12:13:40.382 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2023-01-25T12:13:40.402 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2023-01-25T12:13:40.402 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2023-01-25T12:13:40.402 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2023-01-25T12:13:40.402 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2023-01-25T12:13:40.403 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 19 2023-01-25T12:13:40.403 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T12:13:40.403 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2023-01-25T12:13:40.403 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2023-01-25T12:13:40.403 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.4.0.137.135 2023-01-25T12:13:40.404 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T12:13:40.404 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T12:13:40.404 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2023-01-25T12:13:40.404 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2023-01-25T12:13:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2023-01-25T12:13:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2023-01-25T12:13:40.405 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-01-25T12:13:40.410 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.tGwqgpWLGJ 2023-01-25T12:13:40.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tGwqgpWLGJ 2023-01-25T12:13:40.423 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.tGwqgpWLGJ 2023-01-25T12:13:40.502 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.tGwqgpWLGJ is 9KB 2023-01-25T12:13:40.516 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.tGwqgpWLGJ 2023-01-25T12:13:40.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-01-25T12:13:40.578 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:13:40.579 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-01-25T12:13:40.579 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-01-25T12:13:40.606 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-137-generic 2023-01-25T12:13:40.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo update-grub 2023-01-25T12:13:40.941 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-01-25T12:13:40.966 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T12:13:41.037 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-01-25T12:13:41.203 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2023-01-25T12:13:41.203 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2023-01-25T12:13:41.393 INFO:teuthology.orchestra.run.smithi148.stdout:linux-image-generic is already the newest version (5.4.0.137.135). 2023-01-25T12:13:41.393 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 0 newly installed, 0 to remove and 133 not upgraded. 2023-01-25T12:13:41.395 DEBUG:teuthology.orchestra.run.smithi148:> dpkg -s linux-image-generic 2023-01-25T12:13:41.417 INFO:teuthology.orchestra.run.smithi148.stdout:Package: linux-image-generic 2023-01-25T12:13:41.417 INFO:teuthology.orchestra.run.smithi148.stdout:Status: install ok installed 2023-01-25T12:13:41.417 INFO:teuthology.orchestra.run.smithi148.stdout:Priority: optional 2023-01-25T12:13:41.417 INFO:teuthology.orchestra.run.smithi148.stdout:Section: kernel 2023-01-25T12:13:41.418 INFO:teuthology.orchestra.run.smithi148.stdout:Installed-Size: 19 2023-01-25T12:13:41.418 INFO:teuthology.orchestra.run.smithi148.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T12:13:41.418 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: amd64 2023-01-25T12:13:41.418 INFO:teuthology.orchestra.run.smithi148.stdout:Source: linux-meta 2023-01-25T12:13:41.418 INFO:teuthology.orchestra.run.smithi148.stdout:Version: 5.4.0.137.135 2023-01-25T12:13:41.419 INFO:teuthology.orchestra.run.smithi148.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T12:13:41.419 INFO:teuthology.orchestra.run.smithi148.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T12:13:41.419 INFO:teuthology.orchestra.run.smithi148.stdout:Recommends: thermald 2023-01-25T12:13:41.419 INFO:teuthology.orchestra.run.smithi148.stdout:Description: Generic Linux kernel image 2023-01-25T12:13:41.419 INFO:teuthology.orchestra.run.smithi148.stdout: This package will always depend on the latest generic kernel image 2023-01-25T12:13:41.420 INFO:teuthology.orchestra.run.smithi148.stdout: available. 2023-01-25T12:13:41.420 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-01-25T12:13:41.426 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.l8qOA1bhSi 2023-01-25T12:13:41.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub/grub.cfg /tmp/tmp.l8qOA1bhSi 2023-01-25T12:13:41.484 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.l8qOA1bhSi 2023-01-25T12:13:41.519 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.l8qOA1bhSi is 9KB 2023-01-25T12:13:41.532 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.l8qOA1bhSi 2023-01-25T12:13:41.538 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-01-25T12:13:41.594 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:13:41.594 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-01-25T12:13:41.594 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-01-25T12:13:41.630 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-137-generic 2023-01-25T12:13:41.630 DEBUG:teuthology.orchestra.run.smithi148:> sudo update-grub 2023-01-25T12:13:42.072 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2023-01-25T12:13:42.077 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T12:13:42.095 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2023-01-25T12:13:42.349 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T12:13:42.360 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T12:13:42.699 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T12:13:42.710 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T12:13:42.922 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub' 2023-01-25T12:13:42.929 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T12:13:42.944 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2023-01-25T12:13:43.188 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T12:13:43.199 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T12:13:43.542 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T12:13:43.553 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T12:13:44.352 INFO:teuthology.orchestra.run.smithi117.stderr:done 2023-01-25T12:13:44.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2023-01-25T12:13:45.178 INFO:teuthology.orchestra.run.smithi148.stderr:done 2023-01-25T12:13:45.180 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2023-01-25T12:14:14.384 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-01-25T12:14:14.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-01-25T12:14:14.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T12:14:15.184 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-01-25T12:14:15.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-01-25T12:14:15.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T12:14:48.936 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-01-25T12:14:49.708 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-01-25T12:15:18.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-01-25T12:15:18.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T12:15:19.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-01-25T12:15:19.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T12:15:26.270 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-01-25T12:15:27.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-01-25T12:15:27.135 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-137-generic"... 2023-01-25T12:15:27.135 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2023-01-25T12:15:27.140 INFO:teuthology.orchestra.run.smithi117.stdout:5.4.0-137-generic 2023-01-25T12:15:27.141 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-137-generic vs 5.4.0-137-generic 2023-01-25T12:15:27.141 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T12:15:27.141 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-01-25T12:15:27.166 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-01-25T12:15:27.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-01-25T12:15:27.970 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-137-generic"... 2023-01-25T12:15:27.971 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-01-25T12:15:27.976 INFO:teuthology.orchestra.run.smithi148.stdout:5.4.0-137-generic 2023-01-25T12:15:27.977 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-137-generic vs 5.4.0-137-generic 2023-01-25T12:15:27.977 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T12:15:27.977 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-01-25T12:15:28.142 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T12:15:28.143 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T12:15:28.296 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2023-01-25T12:15:28.324 DEBUG:teuthology.parallel:result is None 2023-01-25T12:15:28.978 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-25T12:15:28.978 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T12:15:29.090 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2023-01-25T12:15:29.111 DEBUG:teuthology.parallel:result is None 2023-01-25T12:15:29.111 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T12:15:29.119 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T12:15:29.119 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T12:15:29.122 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T12:15:29.129 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T12:15:29.142 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T12:15:29.175 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T12:15:29.175 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T12:15:29.178 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T12:15:29.217 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T12:15:29.225 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T12:15:29.225 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T12:15:29.228 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T12:15:29.253 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T12:15:29.255 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T12:15:29.264 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T12:15:29.265 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T12:15:29.266 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T12:15:29.273 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T12:15:29.274 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T12:15:29.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T12:15:29.327 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T12:15:29.340 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T12:15:29.340 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T12:15:29.343 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T12:15:29.351 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T12:15:29.359 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T12:15:29.412 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:15:29.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T12:15:29.433 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T12:15:29.441 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T12:15:29.496 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:15:29.496 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T12:15:29.520 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2023-01-25T12:15:29.523 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2023-01-25T12:15:29.579 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T12:15:29.588 INFO:teuthology.task.internal:Starting timer... 2023-01-25T12:15:29.588 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T12:15:29.615 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T12:15:29.644 DEBUG:teuthology.task.selinux:Excluding smithi117: OS 'ubuntu' does not support SELinux 2023-01-25T12:15:29.645 DEBUG:teuthology.task.selinux:Excluding smithi148: OS 'ubuntu' does not support SELinux 2023-01-25T12:15:29.645 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T12:15:29.646 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-01-25T12:15:29.646 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T12:15:29.646 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T12:15:29.678 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-25T12:15:29.679 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T12:15:29.704 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T12:15:29.706 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi117.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T12:20:08.896 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi117.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2023-01-25T12:20:08.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-01-25T12:20:08.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T12:20:08.946 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-01-25T12:20:09.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-01-25T12:20:09.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T12:20:09.113 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-01-25T12:20:09.238 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T12:20:09.247 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T12:20:09.247 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T12:20:09.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T12:20:09.250 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T12:20:09.251 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T12:20:09.279 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-01-25T12:20:09.279 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: Command line: ntpd -gq 2023-01-25T12:20:09.281 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: proto: precision = 0.253 usec (-22) 2023-01-25T12:20:09.281 INFO:teuthology.orchestra.run.smithi117.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T12:20:09.282 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T12:20:09.282 INFO:teuthology.orchestra.run.smithi117.stderr:restrict ::: KOD does nothing without LIMITED. 2023-01-25T12:20:09.283 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: restrict ::: KOD does nothing without LIMITED. 2023-01-25T12:20:09.283 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: Listen and drop on 0 v6wildcard [::]:123 2023-01-25T12:20:09.283 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-01-25T12:20:09.283 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: Listen normally on 2 lo 127.0.0.1:123 2023-01-25T12:20:09.284 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: Listen normally on 3 enp3s0f1 172.21.15.117:123 2023-01-25T12:20:09.284 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: Listen normally on 4 lo [::1]:123 2023-01-25T12:20:09.284 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4463%5]:123 2023-01-25T12:20:09.284 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:09 ntpd[19468]: Listening on routing socket on fd #22 for interface updates 2023-01-25T12:20:09.286 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-01-25T12:20:09.286 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: Command line: ntpd -gq 2023-01-25T12:20:09.287 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: proto: precision = 0.093 usec (-23) 2023-01-25T12:20:09.287 INFO:teuthology.orchestra.run.smithi148.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T12:20:09.288 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T12:20:09.288 INFO:teuthology.orchestra.run.smithi148.stderr:restrict ::: KOD does nothing without LIMITED. 2023-01-25T12:20:09.289 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: restrict ::: KOD does nothing without LIMITED. 2023-01-25T12:20:09.289 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: Listen and drop on 0 v6wildcard [::]:123 2023-01-25T12:20:09.289 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-01-25T12:20:09.290 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: Listen normally on 2 lo 127.0.0.1:123 2023-01-25T12:20:09.290 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: Listen normally on 3 enp3s0f1 172.21.15.148:123 2023-01-25T12:20:09.290 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: Listen normally on 4 lo [::1]:123 2023-01-25T12:20:09.290 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7257%5]:123 2023-01-25T12:20:09.290 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:09 ntpd[19407]: Listening on routing socket on fd #22 for interface updates 2023-01-25T12:20:10.280 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:10 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:10.280 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:10 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:10.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:10 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:10.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:10 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:10.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:10 ntpd[19468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:10.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:10 ntpd[19468]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:12.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:12.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:12.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:12.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:12.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:12.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:12.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:12.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:12.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:12.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:12.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:12.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:12.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:12.284 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:12 ntpd[19468]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:12.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:12 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:12.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:12 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:12.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:12 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:12 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:12 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:12 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:12 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:12 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:13.280 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:13 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:13.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:13 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:13.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:13 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:13.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:13 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:13.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:13 ntpd[19468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:13.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:13 ntpd[19468]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:13.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:13.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:13.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:13.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:13.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:13.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:13.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:13.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:13.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:13.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:13.290 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:13.290 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:13 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:14.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:14.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:14.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:14.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:14.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:14.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:14.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:14.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:14.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:14.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:14.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:14.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:14 ntpd[19468]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:14.286 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:14 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:14.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:14 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:14.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:14 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:14.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:14 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:14.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:14 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:14.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:14 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:15.280 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:15 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:15.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:15 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:15.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:15 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:15.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:15 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:15.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:15 ntpd[19468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:15.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:15 ntpd[19468]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:15.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:15.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:15.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:15.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:15.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:15.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:15.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:15.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:15.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:15.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:15.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:15.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:15 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:16.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:16.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:16.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:16.281 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:16.282 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:16.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:16.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:16.283 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:16.283 INFO:teuthology.orchestra.run.smithi117.stdout:25 Jan 12:20:16 ntpd[19468]: ntpd: time slew +0.000415 s 2023-01-25T12:20:16.284 INFO:teuthology.orchestra.run.smithi117.stdout:ntpd: time slew +0.000415s 2023-01-25T12:20:16.284 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-01-25T12:20:16.284 INFO:teuthology.orchestra.run.smithi117.stderr:25 Jan 12:20:16 ntpd[19468]: can't open /var/log/ntpstats/loopstats.20230125: Permission denied 2023-01-25T12:20:16.286 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:16 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:16.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:16 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:16.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:16 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:16.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:16 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:16.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:16 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:16.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:16 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2023-01-25T12:20:16.357 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2023-01-25T12:20:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T12:20:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T12:20:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T12:20:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T12:20:17.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:17.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:17.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:17.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:17.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:17.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:17 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:18.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:18 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:18.287 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:18 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:18.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:18 ntpd[19407]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T12:20:18.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:18 ntpd[19407]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T12:20:18.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:18 ntpd[19407]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T12:20:18.288 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:18 ntpd[19407]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T12:20:18.289 INFO:teuthology.orchestra.run.smithi148.stdout:25 Jan 12:20:18 ntpd[19407]: ntpd: time slew -0.000057 s 2023-01-25T12:20:18.289 INFO:teuthology.orchestra.run.smithi148.stdout:ntpd: time slew -0.000057s 2023-01-25T12:20:18.289 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:18 ntpd[19407]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-01-25T12:20:18.290 INFO:teuthology.orchestra.run.smithi148.stderr:25 Jan 12:20:18 ntpd[19407]: can't open /var/log/ntpstats/loopstats.20230125: Permission denied 2023-01-25T12:20:18.355 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2023-01-25T12:20:18.356 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2023-01-25T12:20:18.356 INFO:teuthology.orchestra.run.smithi148.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T12:20:18.356 INFO:teuthology.orchestra.run.smithi148.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T12:20:18.356 INFO:teuthology.orchestra.run.smithi148.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T12:20:18.357 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T12:20:18.358 INFO:teuthology.run_tasks:Running task install... 2023-01-25T12:20:18.366 DEBUG:teuthology.task.install:project ceph 2023-01-25T12:20:18.366 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}} 2023-01-25T12:20:18.366 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'} 2023-01-25T12:20:18.367 INFO:teuthology.task.install:Using flavor: default 2023-01-25T12:20:18.373 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T12:20:18.373 INFO:teuthology.task.install:extra packages: [] 2023-01-25T12:20:18.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2023-01-25T12:20:18.426 INFO:teuthology.orchestra.run.smithi117.stdout:Ubuntu 2023-01-25T12:20:18.431 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T12:20:18.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo lsb_release -is 2023-01-25T12:20:18.432 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-key list | grep Ceph 2023-01-25T12:20:18.483 INFO:teuthology.orchestra.run.smithi148.stdout:Ubuntu 2023-01-25T12:20:18.489 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T12:20:18.489 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-key list | grep Ceph 2023-01-25T12:20:18.528 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-01-25T12:20:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-01-25T12:20:18.589 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-01-25T12:20:18.589 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph.com (release key) 2023-01-25T12:20:18.590 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2023-01-25T12:20:18.637 INFO:teuthology.orchestra.run.smithi117.stdout:Ubuntu 2023-01-25T12:20:18.640 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-01-25T12:20:18.640 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph.com (release key) 2023-01-25T12:20:18.641 DEBUG:teuthology.orchestra.run.smithi148:> sudo lsb_release -is 2023-01-25T12:20:18.642 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T12:20:18.643 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-01-25T12:20:18.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T12:20:18.696 INFO:teuthology.orchestra.run.smithi148.stdout:Ubuntu 2023-01-25T12:20:18.702 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T12:20:18.702 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-01-25T12:20:18.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T12:20:18.792 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default/ 2023-01-25T12:20:18.793 INFO:teuthology.task.install.deb:Package version is 18.0.0-1986-g44e4095d-1focal 2023-01-25T12:20:18.851 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default/ 2023-01-25T12:20:18.851 INFO:teuthology.task.install.deb:Package version is 18.0.0-1986-g44e4095d-1focal 2023-01-25T12:20:18.906 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:20:18.907 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-01-25T12:20:18.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2023-01-25T12:20:18.975 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:20:18.976 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-01-25T12:20:18.989 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2023-01-25T12:20:19.130 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T12:20:19.170 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal InRelease 2023-01-25T12:20:19.193 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-01-25T12:20:19.194 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal InRelease 2023-01-25T12:20:19.217 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-01-25T12:20:19.218 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release.gpg 2023-01-25T12:20:19.240 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2023-01-25T12:20:19.241 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release.gpg 2023-01-25T12:20:19.264 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2023-01-25T12:20:19.272 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T12:20:19.272 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:6 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T12:20:19.290 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T12:20:19.295 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-01-25T12:20:19.314 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-01-25T12:20:19.336 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T12:20:19.370 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T12:20:19.427 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T12:20:19.461 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T12:20:19.808 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 28.4 kB in 1s (43.7 kB/s) 2023-01-25T12:20:19.928 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 28.4 kB in 1s (35.5 kB/s) 2023-01-25T12:20:20.753 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-01-25T12:20:20.776 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-1986-g44e4095d-1focal cephadm=18.0.0-1986-g44e4095d-1focal ceph-mds=18.0.0-1986-g44e4095d-1focal ceph-mgr=18.0.0-1986-g44e4095d-1focal ceph-common=18.0.0-1986-g44e4095d-1focal ceph-fuse=18.0.0-1986-g44e4095d-1focal ceph-test=18.0.0-1986-g44e4095d-1focal ceph-volume=18.0.0-1986-g44e4095d-1focal radosgw=18.0.0-1986-g44e4095d-1focal python3-rados=18.0.0-1986-g44e4095d-1focal python3-rgw=18.0.0-1986-g44e4095d-1focal python3-cephfs=18.0.0-1986-g44e4095d-1focal python3-rbd=18.0.0-1986-g44e4095d-1focal libcephfs2=18.0.0-1986-g44e4095d-1focal libcephfs-dev=18.0.0-1986-g44e4095d-1focal librados2=18.0.0-1986-g44e4095d-1focal librbd1=18.0.0-1986-g44e4095d-1focal rbd-fuse=18.0.0-1986-g44e4095d-1focal 2023-01-25T12:20:20.844 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2023-01-25T12:20:20.867 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-01-25T12:20:20.891 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-1986-g44e4095d-1focal cephadm=18.0.0-1986-g44e4095d-1focal ceph-mds=18.0.0-1986-g44e4095d-1focal ceph-mgr=18.0.0-1986-g44e4095d-1focal ceph-common=18.0.0-1986-g44e4095d-1focal ceph-fuse=18.0.0-1986-g44e4095d-1focal ceph-test=18.0.0-1986-g44e4095d-1focal ceph-volume=18.0.0-1986-g44e4095d-1focal radosgw=18.0.0-1986-g44e4095d-1focal python3-rados=18.0.0-1986-g44e4095d-1focal python3-rgw=18.0.0-1986-g44e4095d-1focal python3-cephfs=18.0.0-1986-g44e4095d-1focal python3-rbd=18.0.0-1986-g44e4095d-1focal libcephfs2=18.0.0-1986-g44e4095d-1focal libcephfs-dev=18.0.0-1986-g44e4095d-1focal librados2=18.0.0-1986-g44e4095d-1focal librbd1=18.0.0-1986-g44e4095d-1focal rbd-fuse=18.0.0-1986-g44e4095d-1focal 2023-01-25T12:20:20.956 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-01-25T12:20:21.009 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2023-01-25T12:20:21.009 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2023-01-25T12:20:21.122 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2023-01-25T12:20:21.123 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2023-01-25T12:20:21.164 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2023-01-25T12:20:21.165 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-01-25T12:20:21.165 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2023-01-25T12:20:21.165 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2023-01-25T12:20:21.165 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-01-25T12:20:21.166 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-01-25T12:20:21.166 INFO:teuthology.orchestra.run.smithi148.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-01-25T12:20:21.166 INFO:teuthology.orchestra.run.smithi148.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-01-25T12:20:21.166 INFO:teuthology.orchestra.run.smithi148.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-01-25T12:20:21.167 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-01-25T12:20:21.167 INFO:teuthology.orchestra.run.smithi148.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-01-25T12:20:21.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-01-25T12:20:21.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-01-25T12:20:21.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-01-25T12:20:21.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-01-25T12:20:21.169 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T12:20:21.169 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T12:20:21.169 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T12:20:21.169 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T12:20:21.169 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T12:20:21.170 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-01-25T12:20:21.170 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-01-25T12:20:21.170 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-01-25T12:20:21.170 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-01-25T12:20:21.170 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-01-25T12:20:21.170 INFO:teuthology.orchestra.run.smithi148.stdout: qttranslations5-l10n socat xmlstarlet 2023-01-25T12:20:21.171 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2023-01-25T12:20:21.171 INFO:teuthology.orchestra.run.smithi148.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-01-25T12:20:21.172 INFO:teuthology.orchestra.run.smithi148.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-01-25T12:20:21.172 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-01-25T12:20:21.172 INFO:teuthology.orchestra.run.smithi148.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-01-25T12:20:21.172 INFO:teuthology.orchestra.run.smithi148.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-01-25T12:20:21.173 INFO:teuthology.orchestra.run.smithi148.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-01-25T12:20:21.173 INFO:teuthology.orchestra.run.smithi148.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-01-25T12:20:21.173 INFO:teuthology.orchestra.run.smithi148.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-01-25T12:20:21.173 INFO:teuthology.orchestra.run.smithi148.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-01-25T12:20:21.173 INFO:teuthology.orchestra.run.smithi148.stdout:Recommended packages: 2023-01-25T12:20:21.174 INFO:teuthology.orchestra.run.smithi148.stdout: btrfs-tools 2023-01-25T12:20:21.277 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2023-01-25T12:20:21.278 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-01-25T12:20:21.279 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2023-01-25T12:20:21.279 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2023-01-25T12:20:21.279 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-01-25T12:20:21.279 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-01-25T12:20:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-01-25T12:20:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-01-25T12:20:21.280 INFO:teuthology.orchestra.run.smithi117.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-01-25T12:20:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-01-25T12:20:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-01-25T12:20:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-01-25T12:20:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-01-25T12:20:21.282 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-01-25T12:20:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-01-25T12:20:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T12:20:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T12:20:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T12:20:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T12:20:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T12:20:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-01-25T12:20:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-01-25T12:20:21.284 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-01-25T12:20:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-01-25T12:20:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-01-25T12:20:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: qttranslations5-l10n socat xmlstarlet 2023-01-25T12:20:21.285 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2023-01-25T12:20:21.285 INFO:teuthology.orchestra.run.smithi117.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-01-25T12:20:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-01-25T12:20:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-01-25T12:20:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-01-25T12:20:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-01-25T12:20:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-01-25T12:20:21.286 INFO:teuthology.orchestra.run.smithi117.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-01-25T12:20:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-01-25T12:20:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-01-25T12:20:21.287 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2023-01-25T12:20:21.287 INFO:teuthology.orchestra.run.smithi117.stdout: btrfs-tools 2023-01-25T12:20:21.288 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2023-01-25T12:20:21.288 INFO:teuthology.orchestra.run.smithi148.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-01-25T12:20:21.289 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-01-25T12:20:21.289 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-01-25T12:20:21.289 INFO:teuthology.orchestra.run.smithi148.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-01-25T12:20:21.289 INFO:teuthology.orchestra.run.smithi148.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-01-25T12:20:21.289 INFO:teuthology.orchestra.run.smithi148.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-01-25T12:20:21.290 INFO:teuthology.orchestra.run.smithi148.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-01-25T12:20:21.290 INFO:teuthology.orchestra.run.smithi148.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-01-25T12:20:21.290 INFO:teuthology.orchestra.run.smithi148.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-01-25T12:20:21.290 INFO:teuthology.orchestra.run.smithi148.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-01-25T12:20:21.290 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-01-25T12:20:21.291 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-01-25T12:20:21.291 INFO:teuthology.orchestra.run.smithi148.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-01-25T12:20:21.291 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T12:20:21.291 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T12:20:21.291 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T12:20:21.292 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T12:20:21.292 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T12:20:21.292 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-01-25T12:20:21.292 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-01-25T12:20:21.292 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-01-25T12:20:21.293 INFO:teuthology.orchestra.run.smithi148.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-01-25T12:20:21.293 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-01-25T12:20:21.293 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-01-25T12:20:21.293 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet 2023-01-25T12:20:21.293 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages will be upgraded: 2023-01-25T12:20:21.294 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 librbd1 2023-01-25T12:20:21.345 INFO:teuthology.orchestra.run.smithi148.stdout:2 upgraded, 110 newly installed, 0 to remove and 128 not upgraded. 2023-01-25T12:20:21.346 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 199 MB of archives. 2023-01-25T12:20:21.346 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 975 MB of additional disk space will be used. 2023-01-25T12:20:21.346 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-01-25T12:20:21.390 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2023-01-25T12:20:21.391 INFO:teuthology.orchestra.run.smithi117.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-01-25T12:20:21.391 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-01-25T12:20:21.391 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-01-25T12:20:21.391 INFO:teuthology.orchestra.run.smithi117.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-01-25T12:20:21.392 INFO:teuthology.orchestra.run.smithi117.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-01-25T12:20:21.392 INFO:teuthology.orchestra.run.smithi117.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-01-25T12:20:21.392 INFO:teuthology.orchestra.run.smithi117.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-01-25T12:20:21.393 INFO:teuthology.orchestra.run.smithi117.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-01-25T12:20:21.393 INFO:teuthology.orchestra.run.smithi117.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-01-25T12:20:21.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-01-25T12:20:21.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-01-25T12:20:21.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-01-25T12:20:21.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-01-25T12:20:21.394 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T12:20:21.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T12:20:21.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T12:20:21.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T12:20:21.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T12:20:21.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-01-25T12:20:21.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-01-25T12:20:21.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-01-25T12:20:21.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-01-25T12:20:21.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-01-25T12:20:21.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-01-25T12:20:21.398 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet 2023-01-25T12:20:21.398 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2023-01-25T12:20:21.398 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 librbd1 2023-01-25T12:20:21.428 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-01-25T12:20:21.430 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-01-25T12:20:21.448 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-01-25T12:20:21.450 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-1986-g44e4095d-1focal [3,428 kB] 2023-01-25T12:20:21.455 INFO:teuthology.orchestra.run.smithi117.stdout:2 upgraded, 110 newly installed, 0 to remove and 128 not upgraded. 2023-01-25T12:20:21.455 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 199 MB of archives. 2023-01-25T12:20:21.455 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 975 MB of additional disk space will be used. 2023-01-25T12:20:21.455 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-01-25T12:20:21.499 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-01-25T12:20:21.502 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-01-25T12:20:21.508 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-01-25T12:20:21.510 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-01-25T12:20:21.510 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-01-25T12:20:21.511 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-01-25T12:20:21.511 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-01-25T12:20:21.514 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-01-25T12:20:21.515 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-01-25T12:20:21.517 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-01-25T12:20:21.534 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-01-25T12:20:21.534 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-01-25T12:20:21.535 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-01-25T12:20:21.536 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-01-25T12:20:21.536 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-01-25T12:20:21.536 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-01-25T12:20:21.537 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-01-25T12:20:21.538 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-01-25T12:20:21.538 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-01-25T12:20:21.540 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-01-25T12:20:21.540 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-01-25T12:20:21.547 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-1986-g44e4095d-1focal [3,428 kB] 2023-01-25T12:20:21.550 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-01-25T12:20:21.558 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-01-25T12:20:21.559 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-01-25T12:20:21.566 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-01-25T12:20:21.567 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-01-25T12:20:21.568 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-01-25T12:20:21.568 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-01-25T12:20:21.570 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-01-25T12:20:21.573 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-01-25T12:20:21.575 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-01-25T12:20:21.575 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-01-25T12:20:21.584 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-01-25T12:20:21.586 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-01-25T12:20:21.586 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-01-25T12:20:21.601 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-01-25T12:20:21.602 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-01-25T12:20:21.603 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-01-25T12:20:21.605 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-01-25T12:20:21.605 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-01-25T12:20:21.605 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-01-25T12:20:21.606 INFO:teuthology.orchestra.run.smithi148.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-01-25T12:20:21.610 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-01-25T12:20:21.612 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-01-25T12:20:21.618 INFO:teuthology.orchestra.run.smithi148.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-01-25T12:20:21.619 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-01-25T12:20:21.619 INFO:teuthology.orchestra.run.smithi148.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-01-25T12:20:21.620 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-01-25T12:20:21.621 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-01-25T12:20:21.621 INFO:teuthology.orchestra.run.smithi148.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-01-25T12:20:21.622 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-01-25T12:20:21.622 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-01-25T12:20:21.625 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-01-25T12:20:21.625 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-01-25T12:20:21.628 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-01-25T12:20:21.635 INFO:teuthology.orchestra.run.smithi148.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-01-25T12:20:21.637 INFO:teuthology.orchestra.run.smithi148.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-01-25T12:20:21.638 INFO:teuthology.orchestra.run.smithi148.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-01-25T12:20:21.639 INFO:teuthology.orchestra.run.smithi148.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-01-25T12:20:21.644 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-01-25T12:20:21.645 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-01-25T12:20:21.645 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-01-25T12:20:21.647 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-01-25T12:20:21.647 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-01-25T12:20:21.647 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-01-25T12:20:21.648 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-01-25T12:20:21.649 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-01-25T12:20:21.650 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-01-25T12:20:21.661 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-01-25T12:20:21.666 INFO:teuthology.orchestra.run.smithi148.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-1986-g44e4095d-1focal [3,962 kB] 2023-01-25T12:20:21.669 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-01-25T12:20:21.675 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-01-25T12:20:21.676 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-01-25T12:20:21.676 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-01-25T12:20:21.677 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-01-25T12:20:21.678 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-01-25T12:20:21.680 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-01-25T12:20:21.683 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-01-25T12:20:21.684 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-01-25T12:20:21.696 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-01-25T12:20:21.697 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-01-25T12:20:21.697 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-01-25T12:20:21.697 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-01-25T12:20:21.698 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-01-25T12:20:21.713 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-01-25T12:20:21.714 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-01-25T12:20:21.715 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-01-25T12:20:21.715 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-01-25T12:20:21.716 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-01-25T12:20:21.717 INFO:teuthology.orchestra.run.smithi148.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-01-25T12:20:21.730 INFO:teuthology.orchestra.run.smithi117.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-01-25T12:20:21.730 INFO:teuthology.orchestra.run.smithi117.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-01-25T12:20:21.732 INFO:teuthology.orchestra.run.smithi117.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-01-25T12:20:21.733 INFO:teuthology.orchestra.run.smithi117.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-01-25T12:20:21.733 INFO:teuthology.orchestra.run.smithi148.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-01-25T12:20:21.734 INFO:teuthology.orchestra.run.smithi117.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-01-25T12:20:21.734 INFO:teuthology.orchestra.run.smithi148.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-01-25T12:20:21.746 INFO:teuthology.orchestra.run.smithi148.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-01-25T12:20:21.747 INFO:teuthology.orchestra.run.smithi117.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-01-25T12:20:21.747 INFO:teuthology.orchestra.run.smithi117.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-01-25T12:20:21.804 INFO:teuthology.orchestra.run.smithi148.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-01-25T12:20:21.805 INFO:teuthology.orchestra.run.smithi148.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-1986-g44e4095d-1focal [720 kB] 2023-01-25T12:20:21.805 INFO:teuthology.orchestra.run.smithi148.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-01-25T12:20:21.805 INFO:teuthology.orchestra.run.smithi148.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-01-25T12:20:21.806 INFO:teuthology.orchestra.run.smithi148.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-01-25T12:20:21.806 INFO:teuthology.orchestra.run.smithi148.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-01-25T12:20:21.807 INFO:teuthology.orchestra.run.smithi148.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-01-25T12:20:21.808 INFO:teuthology.orchestra.run.smithi148.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-01-25T12:20:21.809 INFO:teuthology.orchestra.run.smithi148.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-01-25T12:20:21.821 INFO:teuthology.orchestra.run.smithi148.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-01-25T12:20:21.826 INFO:teuthology.orchestra.run.smithi148.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-1986-g44e4095d-1focal [376 kB] 2023-01-25T12:20:21.826 INFO:teuthology.orchestra.run.smithi148.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-01-25T12:20:21.827 INFO:teuthology.orchestra.run.smithi117.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-01-25T12:20:21.828 INFO:teuthology.orchestra.run.smithi148.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-01-25T12:20:21.830 INFO:teuthology.orchestra.run.smithi148.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-01-25T12:20:21.831 INFO:teuthology.orchestra.run.smithi148.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-01-25T12:20:21.834 INFO:teuthology.orchestra.run.smithi148.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-1986-g44e4095d-1focal [22.4 kB] 2023-01-25T12:20:21.835 INFO:teuthology.orchestra.run.smithi148.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-1986-g44e4095d-1focal [184 kB] 2023-01-25T12:20:21.835 INFO:teuthology.orchestra.run.smithi148.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-01-25T12:20:21.839 INFO:teuthology.orchestra.run.smithi148.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-01-25T12:20:21.841 INFO:teuthology.orchestra.run.smithi148.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-1986-g44e4095d-1focal [46.5 kB] 2023-01-25T12:20:21.843 INFO:teuthology.orchestra.run.smithi148.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-1986-g44e4095d-1focal [354 kB] 2023-01-25T12:20:21.844 INFO:teuthology.orchestra.run.smithi117.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-01-25T12:20:21.845 INFO:teuthology.orchestra.run.smithi117.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-01-25T12:20:21.855 INFO:teuthology.orchestra.run.smithi148.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-01-25T12:20:21.855 INFO:teuthology.orchestra.run.smithi148.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-1986-g44e4095d-1focal [6,521 kB] 2023-01-25T12:20:21.856 INFO:teuthology.orchestra.run.smithi117.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-01-25T12:20:21.856 INFO:teuthology.orchestra.run.smithi117.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-01-25T12:20:21.857 INFO:teuthology.orchestra.run.smithi117.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-01-25T12:20:21.857 INFO:teuthology.orchestra.run.smithi148.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-01-25T12:20:21.859 INFO:teuthology.orchestra.run.smithi148.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-01-25T12:20:21.897 INFO:teuthology.orchestra.run.smithi148.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-01-25T12:20:21.898 INFO:teuthology.orchestra.run.smithi148.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-01-25T12:20:21.898 INFO:teuthology.orchestra.run.smithi148.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-01-25T12:20:21.899 INFO:teuthology.orchestra.run.smithi148.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-01-25T12:20:21.911 INFO:teuthology.orchestra.run.smithi148.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-01-25T12:20:21.911 INFO:teuthology.orchestra.run.smithi148.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-01-25T12:20:21.912 INFO:teuthology.orchestra.run.smithi148.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-01-25T12:20:21.913 INFO:teuthology.orchestra.run.smithi148.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-01-25T12:20:21.913 INFO:teuthology.orchestra.run.smithi148.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-01-25T12:20:21.918 INFO:teuthology.orchestra.run.smithi117.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-01-25T12:20:21.919 INFO:teuthology.orchestra.run.smithi117.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-01-25T12:20:21.920 INFO:teuthology.orchestra.run.smithi117.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-01-25T12:20:21.921 INFO:teuthology.orchestra.run.smithi117.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-01-25T12:20:21.923 INFO:teuthology.orchestra.run.smithi117.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-01-25T12:20:21.924 INFO:teuthology.orchestra.run.smithi117.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-01-25T12:20:21.925 INFO:teuthology.orchestra.run.smithi117.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-01-25T12:20:21.928 INFO:teuthology.orchestra.run.smithi117.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-01-25T12:20:21.936 INFO:teuthology.orchestra.run.smithi117.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-01-25T12:20:21.947 INFO:teuthology.orchestra.run.smithi117.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-01-25T12:20:21.948 INFO:teuthology.orchestra.run.smithi117.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-01-25T12:20:21.951 INFO:teuthology.orchestra.run.smithi117.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-01-25T12:20:21.955 INFO:teuthology.orchestra.run.smithi117.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-01-25T12:20:21.973 INFO:teuthology.orchestra.run.smithi117.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-01-25T12:20:21.975 INFO:teuthology.orchestra.run.smithi117.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-01-25T12:20:21.977 INFO:teuthology.orchestra.run.smithi117.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-01-25T12:20:22.019 INFO:teuthology.orchestra.run.smithi117.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-01-25T12:20:22.020 INFO:teuthology.orchestra.run.smithi117.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-01-25T12:20:22.020 INFO:teuthology.orchestra.run.smithi117.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-01-25T12:20:22.020 INFO:teuthology.orchestra.run.smithi117.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-01-25T12:20:22.032 INFO:teuthology.orchestra.run.smithi117.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-01-25T12:20:22.032 INFO:teuthology.orchestra.run.smithi117.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-01-25T12:20:22.033 INFO:teuthology.orchestra.run.smithi117.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-01-25T12:20:22.033 INFO:teuthology.orchestra.run.smithi117.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-01-25T12:20:22.034 INFO:teuthology.orchestra.run.smithi117.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-01-25T12:20:22.091 INFO:teuthology.orchestra.run.smithi148.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-1986-g44e4095d-1focal [104 kB] 2023-01-25T12:20:22.093 INFO:teuthology.orchestra.run.smithi148.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-1986-g44e4095d-1focal [467 kB] 2023-01-25T12:20:22.114 INFO:teuthology.orchestra.run.smithi148.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-1986-g44e4095d-1focal [24.9 MB] 2023-01-25T12:20:22.790 INFO:teuthology.orchestra.run.smithi117.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-1986-g44e4095d-1focal [3,962 kB] 2023-01-25T12:20:23.119 INFO:teuthology.orchestra.run.smithi148.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-1986-g44e4095d-1focal [10.3 MB] 2023-01-25T12:20:23.452 INFO:teuthology.orchestra.run.smithi148.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-1986-g44e4095d-1focal [221 kB] 2023-01-25T12:20:23.457 INFO:teuthology.orchestra.run.smithi148.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-1986-g44e4095d-1focal [133 kB] 2023-01-25T12:20:23.463 INFO:teuthology.orchestra.run.smithi148.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-1986-g44e4095d-1focal [1,534 kB] 2023-01-25T12:20:23.499 INFO:teuthology.orchestra.run.smithi117.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-1986-g44e4095d-1focal [720 kB] 2023-01-25T12:20:23.527 INFO:teuthology.orchestra.run.smithi148.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-1986-g44e4095d-1focal [7,860 kB] 2023-01-25T12:20:23.643 INFO:teuthology.orchestra.run.smithi117.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-1986-g44e4095d-1focal [376 kB] 2023-01-25T12:20:23.717 INFO:teuthology.orchestra.run.smithi117.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-1986-g44e4095d-1focal [22.4 kB] 2023-01-25T12:20:23.718 INFO:teuthology.orchestra.run.smithi117.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-1986-g44e4095d-1focal [184 kB] 2023-01-25T12:20:23.724 INFO:teuthology.orchestra.run.smithi117.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-1986-g44e4095d-1focal [46.5 kB] 2023-01-25T12:20:23.726 INFO:teuthology.orchestra.run.smithi117.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-1986-g44e4095d-1focal [354 kB] 2023-01-25T12:20:23.799 INFO:teuthology.orchestra.run.smithi117.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-1986-g44e4095d-1focal [6,521 kB] 2023-01-25T12:20:23.855 INFO:teuthology.orchestra.run.smithi148.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-1986-g44e4095d-1focal [27.5 MB] 2023-01-25T12:20:24.693 INFO:teuthology.orchestra.run.smithi117.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-1986-g44e4095d-1focal [104 kB] 2023-01-25T12:20:24.695 INFO:teuthology.orchestra.run.smithi117.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-1986-g44e4095d-1focal [467 kB] 2023-01-25T12:20:24.748 INFO:teuthology.orchestra.run.smithi117.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-1986-g44e4095d-1focal [24.9 MB] 2023-01-25T12:20:25.156 INFO:teuthology.orchestra.run.smithi148.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-1986-g44e4095d-1focal [3,808 B] 2023-01-25T12:20:25.157 INFO:teuthology.orchestra.run.smithi148.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-1986-g44e4095d-1focal [829 kB] 2023-01-25T12:20:25.170 INFO:teuthology.orchestra.run.smithi148.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-1986-g44e4095d-1focal [2,279 kB] 2023-01-25T12:20:25.193 INFO:teuthology.orchestra.run.smithi148.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-1986-g44e4095d-1focal [96.2 kB] 2023-01-25T12:20:25.195 INFO:teuthology.orchestra.run.smithi148.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-1986-g44e4095d-1focal [115 kB] 2023-01-25T12:20:25.199 INFO:teuthology.orchestra.run.smithi148.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-1986-g44e4095d-1focal [1,787 kB] 2023-01-25T12:20:25.276 INFO:teuthology.orchestra.run.smithi148.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-1986-g44e4095d-1focal [7,881 kB] 2023-01-25T12:20:25.636 INFO:teuthology.orchestra.run.smithi148.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-1986-g44e4095d-1focal [3,932 B] 2023-01-25T12:20:25.637 INFO:teuthology.orchestra.run.smithi148.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-1986-g44e4095d-1focal [48.3 MB] 2023-01-25T12:20:27.931 INFO:teuthology.orchestra.run.smithi117.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-1986-g44e4095d-1focal [10.3 MB] 2023-01-25T12:20:28.086 INFO:teuthology.orchestra.run.smithi148.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-1986-g44e4095d-1focal [225 kB] 2023-01-25T12:20:28.091 INFO:teuthology.orchestra.run.smithi148.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-1986-g44e4095d-1focal [27.4 kB] 2023-01-25T12:20:28.091 INFO:teuthology.orchestra.run.smithi148.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-1986-g44e4095d-1focal [13.3 MB] 2023-01-25T12:20:28.537 INFO:teuthology.orchestra.run.smithi148.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-1986-g44e4095d-1focal [97.2 kB] 2023-01-25T12:20:29.060 INFO:teuthology.orchestra.run.smithi117.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-1986-g44e4095d-1focal [221 kB] 2023-01-25T12:20:29.073 INFO:teuthology.orchestra.run.smithi117.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-1986-g44e4095d-1focal [133 kB] 2023-01-25T12:20:29.083 INFO:teuthology.orchestra.run.smithi117.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-1986-g44e4095d-1focal [1,534 kB] 2023-01-25T12:20:29.148 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 199 MB in 7s (27.5 MB/s) 2023-01-25T12:20:29.196 INFO:teuthology.orchestra.run.smithi117.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-1986-g44e4095d-1focal [7,860 kB] 2023-01-25T12:20:29.340 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-01-25T12:20:29.394 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141754 files and directories currently installed.) 2023-01-25T12:20:29.398 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-01-25T12:20:29.480 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T12:20:29.761 INFO:teuthology.orchestra.run.smithi117.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-1986-g44e4095d-1focal [27.5 MB] 2023-01-25T12:20:29.817 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-01-25T12:20:29.832 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-01-25T12:20:29.866 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T12:20:30.136 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-01-25T12:20:30.154 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-01-25T12:20:30.194 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T12:20:30.673 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-01-25T12:20:30.688 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T12:20:30.742 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:20:31.234 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-01-25T12:20:31.254 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T12:20:31.284 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:20:31.595 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-01-25T12:20:31.614 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T12:20:31.632 INFO:teuthology.orchestra.run.smithi117.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-1986-g44e4095d-1focal [3,808 B] 2023-01-25T12:20:31.632 INFO:teuthology.orchestra.run.smithi117.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-1986-g44e4095d-1focal [829 kB] 2023-01-25T12:20:31.653 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:20:31.654 INFO:teuthology.orchestra.run.smithi117.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-1986-g44e4095d-1focal [2,279 kB] 2023-01-25T12:20:31.788 INFO:teuthology.orchestra.run.smithi117.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-1986-g44e4095d-1focal [96.2 kB] 2023-01-25T12:20:31.789 INFO:teuthology.orchestra.run.smithi117.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-1986-g44e4095d-1focal [115 kB] 2023-01-25T12:20:31.792 INFO:teuthology.orchestra.run.smithi117.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-1986-g44e4095d-1focal [1,787 kB] 2023-01-25T12:20:31.902 INFO:teuthology.orchestra.run.smithi117.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-1986-g44e4095d-1focal [7,881 kB] 2023-01-25T12:20:32.032 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-01-25T12:20:32.048 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-01-25T12:20:32.090 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T12:20:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-1986-g44e4095d-1focal [3,932 B] 2023-01-25T12:20:32.377 INFO:teuthology.orchestra.run.smithi117.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-1986-g44e4095d-1focal [48.3 MB] 2023-01-25T12:20:32.419 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../007-librbd1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:32.526 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librbd1 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T12:20:33.166 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../008-librados2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:33.289 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librados2 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T12:20:34.009 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs2. 2023-01-25T12:20:34.028 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:34.067 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:34.395 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rados. 2023-01-25T12:20:34.412 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../010-python3-rados_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:34.445 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:34.789 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-01-25T12:20:34.805 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:20:34.848 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:35.100 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cephfs. 2023-01-25T12:20:35.118 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:35.158 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:35.420 INFO:teuthology.orchestra.run.smithi117.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-1986-g44e4095d-1focal [225 kB] 2023-01-25T12:20:35.424 INFO:teuthology.orchestra.run.smithi117.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-1986-g44e4095d-1focal [27.4 kB] 2023-01-25T12:20:35.425 INFO:teuthology.orchestra.run.smithi117.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-1986-g44e4095d-1focal [13.3 MB] 2023-01-25T12:20:35.486 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-common. 2023-01-25T12:20:35.505 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:20:35.544 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:35.831 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-prettytable. 2023-01-25T12:20:35.850 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-01-25T12:20:35.922 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-01-25T12:20:35.975 INFO:teuthology.orchestra.run.smithi117.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-1986-g44e4095d-1focal [97.2 kB] 2023-01-25T12:20:36.175 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rbd. 2023-01-25T12:20:36.194 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:36.234 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:36.577 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-01-25T12:20:36.591 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 199 MB in 15s (13.7 MB/s) 2023-01-25T12:20:36.593 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-01-25T12:20:36.635 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T12:20:36.795 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-01-25T12:20:36.851 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141754 files and directories currently installed.) 2023-01-25T12:20:36.855 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-01-25T12:20:36.935 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T12:20:36.992 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-01-25T12:20:37.008 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-01-25T12:20:37.050 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T12:20:37.313 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-01-25T12:20:37.332 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-01-25T12:20:37.397 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-01-25T12:20:37.413 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-01-25T12:20:37.442 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T12:20:37.456 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T12:20:37.858 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-01-25T12:20:37.874 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-01-25T12:20:37.909 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librgw2. 2023-01-25T12:20:37.916 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T12:20:37.925 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../019-librgw2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:37.967 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:38.411 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-01-25T12:20:38.429 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T12:20:38.480 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:20:38.794 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rgw. 2023-01-25T12:20:38.811 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:38.852 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:38.931 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-01-25T12:20:38.949 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T12:20:38.981 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:20:39.231 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liboath0. 2023-01-25T12:20:39.248 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-01-25T12:20:39.289 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-01-25T12:20:39.368 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-01-25T12:20:39.385 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T12:20:39.425 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:20:39.616 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libradosstriper1. 2023-01-25T12:20:39.633 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:39.675 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:39.820 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-01-25T12:20:39.840 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-01-25T12:20:39.878 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T12:20:40.121 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-common. 2023-01-25T12:20:40.137 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../023-ceph-common_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:40.178 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:40.272 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../007-librbd1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:40.381 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librbd1 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T12:20:41.061 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../008-librados2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:41.186 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librados2 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T12:20:41.881 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs2. 2023-01-25T12:20:41.897 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:41.939 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:42.317 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rados. 2023-01-25T12:20:42.333 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../010-python3-rados_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:42.375 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:42.618 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-base. 2023-01-25T12:20:42.633 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../024-ceph-base_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:42.686 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:42.744 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-01-25T12:20:42.764 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:20:42.803 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:43.072 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cephfs. 2023-01-25T12:20:43.090 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:43.121 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:43.450 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-common. 2023-01-25T12:20:43.466 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:20:43.508 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:43.852 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-prettytable. 2023-01-25T12:20:43.870 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-01-25T12:20:43.911 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-01-25T12:20:44.030 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cherrypy3. 2023-01-25T12:20:44.047 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-01-25T12:20:44.105 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-01-25T12:20:44.168 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rbd. 2023-01-25T12:20:44.183 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:44.251 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:44.442 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-natsort. 2023-01-25T12:20:44.459 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-01-25T12:20:44.500 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-01-25T12:20:44.605 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-01-25T12:20:44.623 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-01-25T12:20:44.671 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T12:20:44.795 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-logutils. 2023-01-25T12:20:44.811 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-01-25T12:20:44.853 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-01-25T12:20:45.058 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-01-25T12:20:45.077 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-01-25T12:20:45.124 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T12:20:45.164 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-markupsafe. 2023-01-25T12:20:45.182 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-01-25T12:20:45.222 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-01-25T12:20:45.486 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-01-25T12:20:45.505 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-01-25T12:20:45.517 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-mako. 2023-01-25T12:20:45.535 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-01-25T12:20:45.544 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T12:20:45.575 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T12:20:45.878 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplegeneric. 2023-01-25T12:20:45.898 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-01-25T12:20:45.914 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librgw2. 2023-01-25T12:20:45.928 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-01-25T12:20:45.930 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../019-librgw2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:45.972 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:46.214 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-singledispatch. 2023-01-25T12:20:46.234 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-01-25T12:20:46.272 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T12:20:46.584 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webob. 2023-01-25T12:20:46.600 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-01-25T12:20:46.642 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-01-25T12:20:46.850 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rgw. 2023-01-25T12:20:46.869 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:46.908 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:46.961 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-soupsieve. 2023-01-25T12:20:46.980 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-01-25T12:20:47.019 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T12:20:47.278 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liboath0. 2023-01-25T12:20:47.294 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-01-25T12:20:47.297 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-bs4. 2023-01-25T12:20:47.317 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-01-25T12:20:47.336 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-01-25T12:20:47.364 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-01-25T12:20:47.672 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libradosstriper1. 2023-01-25T12:20:47.690 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:47.717 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-waitress. 2023-01-25T12:20:47.730 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:47.737 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-01-25T12:20:47.778 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T12:20:48.098 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempita. 2023-01-25T12:20:48.115 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-01-25T12:20:48.156 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-01-25T12:20:48.201 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-common. 2023-01-25T12:20:48.218 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../023-ceph-common_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:48.258 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:48.442 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-paste. 2023-01-25T12:20:48.462 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-01-25T12:20:48.500 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T12:20:48.820 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-01-25T12:20:48.836 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-01-25T12:20:48.878 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T12:20:49.215 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastedeploy. 2023-01-25T12:20:49.232 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-01-25T12:20:49.273 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-01-25T12:20:49.584 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webtest. 2023-01-25T12:20:49.602 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-01-25T12:20:49.642 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-01-25T12:20:49.929 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pecan. 2023-01-25T12:20:49.947 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-01-25T12:20:49.987 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T12:20:50.300 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-werkzeug. 2023-01-25T12:20:50.318 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-01-25T12:20:50.350 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T12:20:50.653 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-01-25T12:20:50.669 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:20:50.688 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-base. 2023-01-25T12:20:50.706 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../024-ceph-base_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:50.711 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:50.757 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:51.066 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-01-25T12:20:51.086 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:51.124 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:51.419 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cryptography. 2023-01-25T12:20:51.434 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-01-25T12:20:51.476 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T12:20:51.814 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-openssl. 2023-01-25T12:20:51.829 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-01-25T12:20:51.872 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-01-25T12:20:52.118 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cherrypy3. 2023-01-25T12:20:52.134 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-01-25T12:20:52.201 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-01-25T12:20:52.258 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr. 2023-01-25T12:20:52.274 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:52.316 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:52.538 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-natsort. 2023-01-25T12:20:52.554 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-01-25T12:20:52.621 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-01-25T12:20:52.811 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mon. 2023-01-25T12:20:52.827 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:52.869 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:53.616 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-logutils. 2023-01-25T12:20:53.633 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-01-25T12:20:53.674 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-01-25T12:20:53.993 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-markupsafe. 2023-01-25T12:20:54.010 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-01-25T12:20:54.052 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-01-25T12:20:54.273 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-osd. 2023-01-25T12:20:54.289 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:54.323 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:54.379 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-mako. 2023-01-25T12:20:54.399 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-01-25T12:20:54.438 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T12:20:54.774 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplegeneric. 2023-01-25T12:20:54.793 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-01-25T12:20:54.832 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-01-25T12:20:55.160 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-singledispatch. 2023-01-25T12:20:55.176 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-01-25T12:20:55.219 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T12:20:55.487 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webob. 2023-01-25T12:20:55.507 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-01-25T12:20:55.571 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-01-25T12:20:55.857 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-soupsieve. 2023-01-25T12:20:55.876 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-01-25T12:20:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T12:20:56.229 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bs4. 2023-01-25T12:20:56.246 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-01-25T12:20:56.287 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-01-25T12:20:56.674 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-waitress. 2023-01-25T12:20:56.690 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-01-25T12:20:56.735 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T12:20:56.917 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph. 2023-01-25T12:20:56.937 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../050-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:56.976 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:57.077 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempita. 2023-01-25T12:20:57.094 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-01-25T12:20:57.135 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-01-25T12:20:57.303 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-fuse. 2023-01-25T12:20:57.322 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:57.361 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:57.446 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-paste. 2023-01-25T12:20:57.463 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-01-25T12:20:57.504 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T12:20:57.789 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mds. 2023-01-25T12:20:57.806 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:57.841 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-01-25T12:20:57.847 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:57.857 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-01-25T12:20:57.899 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T12:20:58.202 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastedeploy. 2023-01-25T12:20:58.219 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-01-25T12:20:58.252 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-01-25T12:20:58.350 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephadm. 2023-01-25T12:20:58.366 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../053-cephadm_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:20:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:58.572 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webtest. 2023-01-25T12:20:58.587 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-01-25T12:20:58.630 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-01-25T12:20:58.728 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-asyncssh. 2023-01-25T12:20:58.744 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-01-25T12:20:58.786 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-01-25T12:20:58.949 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pecan. 2023-01-25T12:20:58.969 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-01-25T12:20:59.008 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T12:20:59.164 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jinja2. 2023-01-25T12:20:59.182 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-01-25T12:20:59.222 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-01-25T12:20:59.387 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-werkzeug. 2023-01-25T12:20:59.405 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-01-25T12:20:59.445 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T12:20:59.517 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-01-25T12:20:59.535 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:20:59.575 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:59.773 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-01-25T12:20:59.790 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:20:59.832 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:20:59.886 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-bcrypt. 2023-01-25T12:20:59.906 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-01-25T12:20:59.969 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T12:21:00.203 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-01-25T12:21:00.221 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:00.261 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:00.281 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jwt. 2023-01-25T12:21:00.296 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-01-25T12:21:00.339 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T12:21:00.589 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cryptography. 2023-01-25T12:21:00.605 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-01-25T12:21:00.647 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T12:21:00.667 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-attr. 2023-01-25T12:21:00.686 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-01-25T12:21:00.725 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-01-25T12:21:00.992 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-openssl. 2023-01-25T12:21:01.012 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-01-25T12:21:01.042 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-01-25T12:21:01.069 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pluggy. 2023-01-25T12:21:01.085 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-01-25T12:21:01.127 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-01-25T12:21:01.412 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr. 2023-01-25T12:21:01.427 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:01.430 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-py. 2023-01-25T12:21:01.447 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-01-25T12:21:01.470 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:01.488 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T12:21:01.825 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-atomicwrites. 2023-01-25T12:21:01.841 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-01-25T12:21:01.884 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T12:21:01.990 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mon. 2023-01-25T12:21:02.007 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:02.048 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:02.194 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-packaging. 2023-01-25T12:21:02.210 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-01-25T12:21:02.252 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-packaging (20.3-1) ... 2023-01-25T12:21:02.538 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-wcwidth. 2023-01-25T12:21:02.554 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-01-25T12:21:02.596 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T12:21:02.908 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pytest. 2023-01-25T12:21:02.925 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-01-25T12:21:02.966 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-01-25T12:21:03.160 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-osd. 2023-01-25T12:21:03.179 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:03.218 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:03.294 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-repoze.lru. 2023-01-25T12:21:03.311 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-01-25T12:21:03.352 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-01-25T12:21:03.588 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjs-underscore. 2023-01-25T12:21:03.607 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-01-25T12:21:03.646 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T12:21:03.951 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-01-25T12:21:03.968 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-01-25T12:21:04.009 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T12:21:04.353 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-routes. 2023-01-25T12:21:04.371 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-01-25T12:21:04.411 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-01-25T12:21:04.714 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-01-25T12:21:04.734 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:04.772 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:05.259 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-decorator. 2023-01-25T12:21:05.278 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-01-25T12:21:05.318 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T12:21:05.653 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-01-25T12:21:05.671 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-01-25T12:21:05.711 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T12:21:05.963 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph. 2023-01-25T12:21:05.981 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../050-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:06.020 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:06.031 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-scipy. 2023-01-25T12:21:06.048 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-01-25T12:21:06.089 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-01-25T12:21:06.298 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-fuse. 2023-01-25T12:21:06.314 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:06.381 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:06.834 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mds. 2023-01-25T12:21:06.851 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:06.892 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:07.412 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-01-25T12:21:07.428 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephadm. 2023-01-25T12:21:07.430 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-01-25T12:21:07.444 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../053-cephadm_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:07.469 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T12:21:07.487 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:07.839 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-asyncssh. 2023-01-25T12:21:07.855 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-01-25T12:21:07.889 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-01-25T12:21:07.981 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-joblib. 2023-01-25T12:21:08.001 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-01-25T12:21:08.040 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-01-25T12:21:08.276 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jinja2. 2023-01-25T12:21:08.296 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-01-25T12:21:08.334 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-01-25T12:21:08.411 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn. 2023-01-25T12:21:08.428 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-01-25T12:21:08.486 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T12:21:08.712 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-01-25T12:21:08.730 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:08.770 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:09.522 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-01-25T12:21:09.538 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:09.557 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bcrypt. 2023-01-25T12:21:09.574 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-01-25T12:21:09.579 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:09.615 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T12:21:09.943 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jwt. 2023-01-25T12:21:09.960 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-01-25T12:21:10.000 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T12:21:10.337 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-attr. 2023-01-25T12:21:10.354 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-01-25T12:21:10.395 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-01-25T12:21:10.700 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cachetools. 2023-01-25T12:21:10.716 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-01-25T12:21:10.756 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pluggy. 2023-01-25T12:21:10.758 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-01-25T12:21:10.772 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-01-25T12:21:10.822 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-01-25T12:21:11.061 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1. 2023-01-25T12:21:11.080 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-01-25T12:21:11.119 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T12:21:11.134 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-py. 2023-01-25T12:21:11.153 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-01-25T12:21:11.192 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T12:21:11.422 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-01-25T12:21:11.442 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-01-25T12:21:11.480 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T12:21:11.529 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-atomicwrites. 2023-01-25T12:21:11.548 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-01-25T12:21:11.586 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T12:21:11.877 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rsa. 2023-01-25T12:21:11.889 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-packaging. 2023-01-25T12:21:11.895 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-01-25T12:21:11.906 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-01-25T12:21:11.935 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rsa (4.0-3) ... 2023-01-25T12:21:11.947 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-packaging (20.3-1) ... 2023-01-25T12:21:12.272 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-google-auth. 2023-01-25T12:21:12.283 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-wcwidth. 2023-01-25T12:21:12.292 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-01-25T12:21:12.299 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-01-25T12:21:12.330 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-01-25T12:21:12.358 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T12:21:12.668 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-blinker. 2023-01-25T12:21:12.685 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-01-25T12:21:12.686 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pytest. 2023-01-25T12:21:12.705 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-01-25T12:21:12.726 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T12:21:12.744 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-01-25T12:21:13.029 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-oauthlib. 2023-01-25T12:21:13.045 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-01-25T12:21:13.087 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T12:21:13.114 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-repoze.lru. 2023-01-25T12:21:13.131 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-01-25T12:21:13.172 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-01-25T12:21:13.391 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-01-25T12:21:13.410 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-01-25T12:21:13.448 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T12:21:13.450 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjs-underscore. 2023-01-25T12:21:13.467 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-01-25T12:21:13.508 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T12:21:13.777 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-websocket. 2023-01-25T12:21:13.777 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-01-25T12:21:13.795 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-01-25T12:21:13.796 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-01-25T12:21:13.835 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T12:21:13.854 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T12:21:14.146 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-kubernetes. 2023-01-25T12:21:14.163 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-01-25T12:21:14.179 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-routes. 2023-01-25T12:21:14.195 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-01-25T12:21:14.204 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T12:21:14.237 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-01-25T12:21:14.560 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-01-25T12:21:14.577 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:14.617 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:14.736 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-01-25T12:21:14.753 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:14.794 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:15.097 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libonig5:amd64. 2023-01-25T12:21:15.116 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-01-25T12:21:15.121 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-decorator. 2023-01-25T12:21:15.141 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-01-25T12:21:15.155 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-01-25T12:21:15.179 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T12:21:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-01-25T12:21:15.487 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-01-25T12:21:15.492 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjq1:amd64. 2023-01-25T12:21:15.511 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T12:21:15.550 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T12:21:15.553 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T12:21:15.816 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package jq. 2023-01-25T12:21:15.835 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T12:21:15.856 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-scipy. 2023-01-25T12:21:15.866 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T12:21:15.872 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-01-25T12:21:15.934 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-01-25T12:21:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package socat. 2023-01-25T12:21:16.144 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-01-25T12:21:16.185 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking socat (1.7.3.3-2) ... 2023-01-25T12:21:16.481 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package xmlstarlet. 2023-01-25T12:21:16.498 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-01-25T12:21:16.538 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-01-25T12:21:16.868 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-test. 2023-01-25T12:21:16.887 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../094-ceph-test_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:16.951 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:17.274 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-01-25T12:21:17.291 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-01-25T12:21:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T12:21:17.894 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-joblib. 2023-01-25T12:21:17.910 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-01-25T12:21:17.952 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-01-25T12:21:18.332 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn. 2023-01-25T12:21:18.350 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-01-25T12:21:18.390 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T12:21:19.116 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-01-25T12:21:19.132 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:19.174 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:20.268 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cachetools. 2023-01-25T12:21:20.288 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-01-25T12:21:20.326 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-01-25T12:21:20.621 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1. 2023-01-25T12:21:20.640 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-01-25T12:21:20.679 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T12:21:21.032 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-01-25T12:21:21.048 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-01-25T12:21:21.090 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T12:21:21.180 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-volume. 2023-01-25T12:21:21.197 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../095-ceph-volume_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:21.238 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:21.495 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rsa. 2023-01-25T12:21:21.511 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-01-25T12:21:21.551 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package fonts-mathjax. 2023-01-25T12:21:21.553 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rsa (4.0-3) ... 2023-01-25T12:21:21.568 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T12:21:21.609 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T12:21:21.899 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-google-auth. 2023-01-25T12:21:21.915 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-01-25T12:21:21.957 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-01-25T12:21:22.139 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs-dev. 2023-01-25T12:21:22.156 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:22.196 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:22.319 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-blinker. 2023-01-25T12:21:22.335 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-01-25T12:21:22.377 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T12:21:22.591 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package nvme-cli. 2023-01-25T12:21:22.608 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-01-25T12:21:22.666 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T12:21:22.697 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-oauthlib. 2023-01-25T12:21:22.713 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-01-25T12:21:22.755 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T12:21:23.004 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-01-25T12:21:23.021 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-01-25T12:21:23.062 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-01-25T12:21:23.092 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-01-25T12:21:23.108 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-01-25T12:21:23.150 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T12:21:23.406 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjs-mathjax. 2023-01-25T12:21:23.422 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T12:21:23.464 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T12:21:23.478 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-websocket. 2023-01-25T12:21:23.497 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-01-25T12:21:23.536 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T12:21:23.864 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-kubernetes. 2023-01-25T12:21:23.880 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-01-25T12:21:23.922 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T12:21:24.484 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-01-25T12:21:24.500 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:24.878 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libonig5:amd64. 2023-01-25T12:21:24.897 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-01-25T12:21:24.936 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-01-25T12:21:25.025 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-natsort-doc. 2023-01-25T12:21:25.047 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-01-25T12:21:25.091 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-01-25T12:21:25.306 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjq1:amd64. 2023-01-25T12:21:25.325 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T12:21:25.364 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T12:21:25.529 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webencodings. 2023-01-25T12:21:25.550 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-01-25T12:21:25.595 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T12:21:25.651 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package jq. 2023-01-25T12:21:25.669 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T12:21:25.708 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T12:21:25.932 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-html5lib. 2023-01-25T12:21:25.949 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-01-25T12:21:25.986 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package socat. 2023-01-25T12:21:26.004 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-01-25T12:21:26.006 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-01-25T12:21:26.044 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking socat (1.7.3.3-2) ... 2023-01-25T12:21:26.397 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package xmlstarlet. 2023-01-25T12:21:26.414 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-01-25T12:21:26.455 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-01-25T12:21:26.652 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-01-25T12:21:26.669 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-01-25T12:21:26.710 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T12:21:26.810 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-test. 2023-01-25T12:21:26.829 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../094-ceph-test_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:26.868 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:27.172 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastescript. 2023-01-25T12:21:27.189 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-01-25T12:21:27.230 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-01-25T12:21:27.550 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-psutil. 2023-01-25T12:21:27.568 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-01-25T12:21:27.608 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T12:21:27.928 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyinotify. 2023-01-25T12:21:27.945 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-01-25T12:21:27.986 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T12:21:28.297 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplejson. 2023-01-25T12:21:28.318 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-01-25T12:21:28.355 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T12:21:28.658 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-01-25T12:21:28.675 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-01-25T12:21:28.716 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T12:21:29.395 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package radosgw. 2023-01-25T12:21:29.412 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../110-radosgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:29.453 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:30.831 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package rbd-fuse. 2023-01-25T12:21:30.849 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:30.889 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:31.116 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-volume. 2023-01-25T12:21:31.130 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../095-ceph-volume_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T12:21:31.172 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:31.208 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-attr (19.3.0-2) ... 2023-01-25T12:21:31.511 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T12:21:31.518 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package fonts-mathjax. 2023-01-25T12:21:31.535 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T12:21:31.576 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T12:21:31.637 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T12:21:31.779 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T12:21:31.981 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:32.115 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs-dev. 2023-01-25T12:21:32.129 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:32.196 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:32.609 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user cephadm....done 2023-01-25T12:21:32.632 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package nvme-cli. 2023-01-25T12:21:32.648 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-01-25T12:21:32.708 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T12:21:32.773 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T12:21:32.898 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T12:21:33.071 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-01-25T12:21:33.090 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-01-25T12:21:33.129 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-01-25T12:21:33.259 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-01-25T12:21:33.532 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjs-mathjax. 2023-01-25T12:21:33.534 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T12:21:33.548 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T12:21:33.590 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T12:21:33.661 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-01-25T12:21:33.787 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T12:21:34.113 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-01-25T12:21:34.507 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T12:21:34.800 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-01-25T12:21:35.084 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T12:21:35.249 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-natsort-doc. 2023-01-25T12:21:35.271 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-01-25T12:21:35.315 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-01-25T12:21:35.377 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T12:21:35.661 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:35.668 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webencodings. 2023-01-25T12:21:35.685 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-01-25T12:21:35.726 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T12:21:35.962 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T12:21:36.062 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-html5lib. 2023-01-25T12:21:36.079 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-01-25T12:21:36.097 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-01-25T12:21:36.120 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-01-25T12:21:36.373 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T12:21:36.490 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-01-25T12:21:36.507 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-01-25T12:21:36.548 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T12:21:36.682 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T12:21:36.808 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T12:21:37.052 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastescript. 2023-01-25T12:21:37.070 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-01-25T12:21:37.109 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-01-25T12:21:37.201 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-01-25T12:21:37.463 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-psutil. 2023-01-25T12:21:37.479 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-01-25T12:21:37.493 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T12:21:37.520 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T12:21:37.770 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T12:21:37.857 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyinotify. 2023-01-25T12:21:37.877 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-01-25T12:21:37.915 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T12:21:38.096 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T12:21:38.242 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplejson. 2023-01-25T12:21:38.259 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-01-25T12:21:38.309 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T12:21:38.389 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-01-25T12:21:38.612 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-01-25T12:21:38.630 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-01-25T12:21:38.661 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T12:21:38.723 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-01-25T12:21:39.016 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-packaging (20.3-1) ... 2023-01-25T12:21:39.317 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T12:21:39.357 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package radosgw. 2023-01-25T12:21:39.375 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../110-radosgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:39.415 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:39.442 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T12:21:39.568 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T12:21:39.853 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T12:21:40.605 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T12:21:40.860 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package rbd-fuse. 2023-01-25T12:21:40.879 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T12:21:40.918 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:40.956 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T12:21:41.243 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-attr (19.3.0-2) ... 2023-01-25T12:21:41.316 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up socat (1.7.3.3-2) ... 2023-01-25T12:21:41.442 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:41.539 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T12:21:41.665 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T12:21:41.760 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:21:41.791 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T12:21:41.894 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-01-25T12:21:42.009 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:42.237 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T12:21:42.363 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-01-25T12:21:42.489 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-01-25T12:21:42.663 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user cephadm....done 2023-01-25T12:21:42.774 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T12:21:42.832 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T12:21:42.958 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T12:21:43.092 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:21:43.234 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T12:21:43.310 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-01-25T12:21:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T12:21:43.594 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T12:21:43.670 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T12:21:43.720 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-01-25T12:21:43.829 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T12:21:43.963 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-01-25T12:21:44.164 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-01-25T12:21:44.247 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T12:21:44.373 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-01-25T12:21:44.582 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T12:21:44.657 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-01-25T12:21:44.892 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-01-25T12:21:44.950 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T12:21:45.194 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T12:21:45.251 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T12:21:45.469 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T12:21:45.677 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-01-25T12:21:45.787 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:45.937 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-01-25T12:21:46.055 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T12:21:46.080 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T12:21:46.206 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-01-25T12:21:46.356 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-01-25T12:21:46.498 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T12:21:46.707 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T12:21:46.791 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T12:21:46.833 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T12:21:46.944 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T12:21:46.959 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-01-25T12:21:47.285 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T12:21:47.320 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-01-25T12:21:47.570 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-01-25T12:21:47.605 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T12:21:47.906 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T12:21:48.232 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T12:21:48.525 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-01-25T12:21:48.859 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-01-25T12:21:49.025 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T12:21:49.151 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-01-25T12:21:49.168 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-packaging (20.3-1) ... 2023-01-25T12:21:49.453 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T12:21:49.536 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-01-25T12:21:49.579 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T12:21:49.696 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T12:21:49.828 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-01-25T12:21:50.006 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T12:21:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:21:50.239 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-01-25T12:21:50.407 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T12:21:50.582 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T12:21:50.783 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T12:21:50.900 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-01-25T12:21:51.152 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up socat (1.7.3.3-2) ... 2023-01-25T12:21:51.278 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:51.283 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T12:21:51.603 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T12:21:51.604 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:21:51.739 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-01-25T12:21:52.123 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T12:21:52.274 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-01-25T12:21:52.400 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-01-25T12:21:52.633 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T12:21:52.684 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T12:21:52.759 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-01-25T12:21:52.885 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T12:21:53.002 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:21:53.030 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rsa (4.0-3) ... 2023-01-25T12:21:53.153 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T12:21:53.271 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T12:21:53.337 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T12:21:53.468 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-01-25T12:21:53.589 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T12:21:53.770 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T12:21:53.848 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-01-25T12:21:54.054 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-01-25T12:21:54.158 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T12:21:54.276 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-01-25T12:21:54.364 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T12:21:54.593 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-01-25T12:21:54.716 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librados2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:54.842 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-01-25T12:21:54.878 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T12:21:54.968 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:55.094 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:55.179 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T12:21:55.305 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:55.431 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-routes (2.4.1-2) ... 2023-01-25T12:21:55.559 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-01-25T12:21:55.724 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:55.823 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-01-25T12:21:55.850 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-01-25T12:21:55.924 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T12:21:56.152 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librbd1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:56.250 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-01-25T12:21:56.301 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:56.429 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:56.602 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T12:21:56.645 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T12:21:56.645 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T12:21:56.728 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T12:21:56.879 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-01-25T12:21:57.064 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:57.165 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:57.239 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T12:21:57.276 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T12:21:57.498 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-01-25T12:21:58.182 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:58.283 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:58.400 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:58.543 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:58.668 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:21:58.945 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T12:21:59.071 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-01-25T12:21:59.221 INFO:teuthology.orchestra.run.smithi148.stdout:Adding group ceph....done 2023-01-25T12:21:59.439 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-01-25T12:21:59.605 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user ceph....done 2023-01-25T12:21:59.749 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-01-25T12:21:59.781 INFO:teuthology.orchestra.run.smithi148.stdout:Setting system user ceph properties....done 2023-01-25T12:21:59.802 INFO:teuthology.orchestra.run.smithi148.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-01-25T12:21:59.949 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-01-25T12:22:00.017 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T12:22:00.168 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-01-25T12:22:00.246 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-01-25T12:22:00.502 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T12:22:00.728 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:00.854 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-01-25T12:22:00.855 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:01.133 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T12:22:01.134 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T12:22:01.255 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T12:22:01.565 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T12:22:01.806 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:02.184 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-01-25T12:22:02.584 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T12:22:02.633 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:02.744 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-01-25T12:22:02.854 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T12:22:02.855 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T12:22:02.870 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T12:22:03.004 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rsa (4.0-3) ... 2023-01-25T12:22:03.318 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:03.330 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T12:22:03.449 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-01-25T12:22:03.550 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T12:22:03.550 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T12:22:03.741 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T12:22:03.986 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:04.000 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-01-25T12:22:04.335 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T12:22:04.507 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T12:22:04.508 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T12:22:04.729 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librados2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:04.855 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-01-25T12:22:04.929 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:04.956 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:05.057 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:05.063 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:05.206 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:05.278 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:05.403 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-routes (2.4.1-2) ... 2023-01-25T12:22:05.424 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T12:22:05.424 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T12:22:05.704 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:05.824 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-01-25T12:22:05.883 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:06.025 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:06.128 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librbd1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:06.176 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:06.254 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:06.413 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:06.536 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:06.638 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T12:22:06.638 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T12:22:06.663 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-01-25T12:22:06.815 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-01-25T12:22:07.031 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:07.108 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-01-25T12:22:07.157 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:07.324 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T12:22:08.244 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:08.370 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:08.521 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:08.647 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:08.765 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:09.360 INFO:teuthology.orchestra.run.smithi117.stdout:Adding group ceph....done 2023-01-25T12:22:09.719 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user ceph....done 2023-01-25T12:22:09.871 INFO:teuthology.orchestra.run.smithi117.stdout:Setting system user ceph properties....done 2023-01-25T12:22:09.905 INFO:teuthology.orchestra.run.smithi117.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-01-25T12:22:09.952 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-01-25T12:22:10.050 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-01-25T12:22:10.348 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-01-25T12:22:10.522 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-01-25T12:22:10.525 DEBUG:teuthology.parallel:result is None 2023-01-25T12:22:10.758 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:11.234 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:11.521 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T12:22:11.521 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T12:22:12.170 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:12.570 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-01-25T12:22:12.971 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:13.196 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T12:22:13.197 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T12:22:13.598 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:13.827 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T12:22:13.827 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T12:22:14.249 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:14.758 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T12:22:14.758 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T12:22:15.201 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:15.327 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:15.689 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T12:22:15.690 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T12:22:16.096 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:16.416 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:16.748 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:16.908 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T12:22:17.036 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-01-25T12:22:17.186 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-01-25T12:22:17.454 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-01-25T12:22:20.298 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-01-25T12:22:20.909 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-01-25T12:22:20.911 DEBUG:teuthology.parallel:result is None 2023-01-25T12:22:20.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2023-01-25T12:22:20.954 INFO:teuthology.orchestra.run.smithi117.stdout:Ubuntu 2023-01-25T12:22:20.959 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T12:22:20.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T12:22:21.165 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' ceph 2023-01-25T12:22:21.188 INFO:teuthology.orchestra.run.smithi117.stdout:18.0.0-1986-g44e4095d-1focal 2023-01-25T12:22:21.189 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1986-g44e4095d-1focal 2023-01-25T12:22:21.189 INFO:teuthology.task.install:The correct ceph version 18.0.0-1986-g44e4095d-1focal is installed. 2023-01-25T12:22:21.190 DEBUG:teuthology.orchestra.run.smithi148:> sudo lsb_release -is 2023-01-25T12:22:21.241 INFO:teuthology.orchestra.run.smithi148.stdout:Ubuntu 2023-01-25T12:22:21.246 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T12:22:21.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T12:22:21.398 DEBUG:teuthology.orchestra.run.smithi148:> dpkg-query -W -f '${Version}' ceph 2023-01-25T12:22:21.422 INFO:teuthology.orchestra.run.smithi148.stdout:18.0.0-1986-g44e4095d-1focal 2023-01-25T12:22:21.422 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1986-g44e4095d-1focal 2023-01-25T12:22:21.422 INFO:teuthology.task.install:The correct ceph version 18.0.0-1986-g44e4095d-1focal is installed. 2023-01-25T12:22:21.423 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T12:22:21.423 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:21.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T12:22:21.440 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:21.441 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T12:22:21.456 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T12:22:21.456 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:21.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T12:22:21.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T12:22:21.507 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:21.508 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T12:22:21.523 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T12:22:21.539 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T12:22:21.539 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:21.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T12:22:21.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T12:22:21.610 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:21.610 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T12:22:21.626 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T12:22:21.684 INFO:teuthology.run_tasks:Running task ceph... 2023-01-25T12:22:21.750 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-25T12:22:21.751 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2023-01-25T12:22:21.753 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2023-01-25T12:22:21.769 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-25T12:22:21.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T12:22:21.771 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T12:22:21.782 INFO:tasks.ceph:Creating extra log directories... 2023-01-25T12:22:21.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T12:22:21.825 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T12:22:21.857 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-25T12:22:21.857 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2023-01-25T12:22:21.857 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137413', 'branch': 'wip-yuri6-testing-2023-01-24-0746', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7137413', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2023-01-24-0746'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'mon_bind_msgr2': False, 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2023-01-24-0746', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2023-01-24-0746', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'targets': {'smithi117.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi148.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'mon_bind_msgr2': False, 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'cluster': 'ceph'}}, {'exec': {'mon.a': ['while ! ceph balancer status ; do sleep 1 ; done', 'ceph balancer mode crush-compat', 'ceph balancer on']}}, {'thrashosds': {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250', 'sudo ceph osd pool set cache min_read_recency_for_promote 2', 'sudo ceph osd pool set cache min_write_recency_for_promote 2']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'write': 100}, 'ops': 4000, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_22:27:30', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-25T12:22:21.858 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T12:22:21.862 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T12:22:21.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T12:22:21.913 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T12:22:21.928 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:21.928 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T12:22:21.933 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T12:22:21.934 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2023-01-25T12:22:21.941 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T12:22:21.941 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T12:22:21.941 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-01-25T12:22:21.941 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T12:22:21.942 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-01-25 12:18:53.328268290 +0000 2023-01-25T12:22:21.942 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-01-25 12:18:53.072274191 +0000 2023-01-25T12:22:21.942 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-01-25 12:18:53.072274191 +0000 2023-01-25T12:22:21.942 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-01-25T12:22:21.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T12:22:21.995 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-01-25T12:22:21.995 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-01-25T12:22:21.996 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000438284 s, 1.2 MB/s 2023-01-25T12:22:21.997 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T12:22:22.006 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2023-01-25T12:22:22.012 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T12:22:22.012 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T12:22:22.013 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 368 Links: 1 2023-01-25T12:22:22.013 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T12:22:22.013 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-01-25 12:18:53.784257779 +0000 2023-01-25T12:22:22.013 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-01-25 12:18:53.520263865 +0000 2023-01-25T12:22:22.013 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-01-25 12:18:53.520263865 +0000 2023-01-25T12:22:22.014 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-01-25T12:22:22.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T12:22:22.029 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-01-25T12:22:22.029 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-01-25T12:22:22.030 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000371535 s, 1.4 MB/s 2023-01-25T12:22:22.030 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T12:22:22.083 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2023-01-25T12:22:22.091 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T12:22:22.091 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T12:22:22.091 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-01-25T12:22:22.091 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T12:22:22.091 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-01-25 12:18:54.020252339 +0000 2023-01-25T12:22:22.092 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-01-25 12:18:54.016252432 +0000 2023-01-25T12:22:22.092 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-01-25 12:18:54.016252432 +0000 2023-01-25T12:22:22.092 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-01-25T12:22:22.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T12:22:22.105 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-01-25T12:22:22.106 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-01-25T12:22:22.106 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000391119 s, 1.3 MB/s 2023-01-25T12:22:22.107 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T12:22:22.159 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2023-01-25T12:22:22.165 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T12:22:22.166 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T12:22:22.166 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-01-25T12:22:22.166 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T12:22:22.166 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-01-25 12:18:54.800234361 +0000 2023-01-25T12:22:22.167 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-01-25 12:18:54.524240722 +0000 2023-01-25T12:22:22.167 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-01-25 12:18:54.524240722 +0000 2023-01-25T12:22:22.167 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-01-25T12:22:22.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T12:22:22.179 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-01-25T12:22:22.179 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-01-25T12:22:22.179 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000437616 s, 1.2 MB/s 2023-01-25T12:22:22.180 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T12:22:22.231 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:22.231 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:22.232 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T12:22:22.240 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T12:22:22.240 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2023-01-25T12:22:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T12:22:22.291 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T12:22:22.291 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-01-25T12:22:22.292 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T12:22:22.292 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-01-25 12:18:53.357609625 +0000 2023-01-25T12:22:22.292 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-01-25 12:18:53.073616174 +0000 2023-01-25T12:22:22.292 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-01-25 12:18:53.073616174 +0000 2023-01-25T12:22:22.292 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-01-25T12:22:22.293 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T12:22:22.303 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-01-25T12:22:22.304 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-01-25T12:22:22.304 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000420484 s, 1.2 MB/s 2023-01-25T12:22:22.305 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T12:22:22.313 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2023-01-25T12:22:22.320 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T12:22:22.320 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-01-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-01-25 12:18:53.849598279 +0000 2023-01-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-01-25 12:18:53.581604459 +0000 2023-01-25T12:22:22.321 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-01-25 12:18:53.581604459 +0000 2023-01-25T12:22:22.322 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-01-25T12:22:22.322 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T12:22:22.334 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-01-25T12:22:22.334 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-01-25T12:22:22.334 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000320419 s, 1.6 MB/s 2023-01-25T12:22:22.335 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T12:22:22.384 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2023-01-25T12:22:22.392 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T12:22:22.392 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T12:22:22.393 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-01-25T12:22:22.393 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T12:22:22.393 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-01-25 12:18:54.517582874 +0000 2023-01-25T12:22:22.393 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-01-25 12:18:54.065593297 +0000 2023-01-25T12:22:22.393 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-01-25 12:18:54.065593297 +0000 2023-01-25T12:22:22.394 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-01-25T12:22:22.394 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T12:22:22.406 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-01-25T12:22:22.407 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-01-25T12:22:22.407 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000396961 s, 1.3 MB/s 2023-01-25T12:22:22.408 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T12:22:22.460 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2023-01-25T12:22:22.467 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T12:22:22.468 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T12:22:22.468 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-01-25T12:22:22.468 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T12:22:22.468 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-01-25 12:18:55.013571436 +0000 2023-01-25T12:22:22.469 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-01-25 12:18:54.749577523 +0000 2023-01-25T12:22:22.469 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-01-25 12:18:54.749577523 +0000 2023-01-25T12:22:22.469 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-01-25T12:22:22.469 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T12:22:22.480 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-01-25T12:22:22.480 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-01-25T12:22:22.480 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000421575 s, 1.2 MB/s 2023-01-25T12:22:22.481 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T12:22:22.532 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:22.532 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T12:22:22.533 INFO:tasks.ceph:Generating config... 2023-01-25T12:22:22.534 INFO:tasks.ceph:[osd] debug monc = 20 2023-01-25T12:22:22.534 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-25T12:22:22.535 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2023-01-25T12:22:22.535 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-01-25T12:22:22.535 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-25T12:22:22.535 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-25T12:22:22.536 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-25T12:22:22.536 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-25T12:22:22.537 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-25T12:22:22.537 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-25T12:22:22.537 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-25T12:22:22.537 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-25T12:22:22.538 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-25T12:22:22.538 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-25T12:22:22.538 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-01-25T12:22:22.539 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2023-01-25T12:22:22.539 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-25T12:22:22.539 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-25T12:22:22.539 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-25T12:22:22.540 INFO:tasks.ceph:[osd] osd heartbeat use min delay socket = True 2023-01-25T12:22:22.540 INFO:tasks.ceph:[osd] osd inject bad map crc probability = 0.1 2023-01-25T12:22:22.540 INFO:tasks.ceph:[osd] osd max backfills = 3 2023-01-25T12:22:22.540 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-25T12:22:22.541 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-25T12:22:22.541 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-25T12:22:22.541 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-25T12:22:22.541 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-25T12:22:22.542 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2023-01-25T12:22:22.542 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2023-01-25T12:22:22.542 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-25T12:22:22.542 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2023-01-25T12:22:22.543 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2023-01-25T12:22:22.543 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2023-01-25T12:22:22.543 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-01-25T12:22:22.543 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-01-25T12:22:22.544 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-01-25T12:22:22.544 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-01-25T12:22:22.544 INFO:tasks.ceph:[global] ms type = async 2023-01-25T12:22:22.544 INFO:tasks.ceph:[global] osd_async_recovery_min_cost = 1 2023-01-25T12:22:22.545 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2023-01-25T12:22:22.545 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2023-01-25T12:22:22.545 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-25T12:22:22.545 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-25T12:22:22.546 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-25T12:22:22.546 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-25T12:22:22.546 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-25T12:22:22.546 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-01-25T12:22:22.547 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-01-25T12:22:22.547 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-01-25T12:22:22.547 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-01-25T12:22:22.548 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-25T12:22:22.548 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-01-25T12:22:22.548 INFO:tasks.ceph:Setting up mon.a... 2023-01-25T12:22:22.549 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-25T12:22:22.589 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.keyring 2023-01-25T12:22:22.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-25T12:22:22.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T12:22:22.711 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.117:6789]'), ('mon.c', '[v1:172.21.15.117:6790]'), ('mon.b', '[v1:172.21.15.148:6789]')] 2023-01-25T12:22:22.712 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.117:6789],[v1:172.21.15.117:6790],[v1:172.21.15.148:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-25T12:22:22.715 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:22.716 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T12:22:22.722 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.117:6789]' --addv c '[v1:172.21.15.117:6790]' --addv b '[v1:172.21.15.148:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:22.808 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:22.809 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: generated fsid 814e11f4-6e34-411d-8202-e91b5ec6cfee 2023-01-25T12:22:22.809 INFO:teuthology.orchestra.run.smithi117.stdout:setting min_mon_release = pacific 2023-01-25T12:22:22.809 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 0 2023-01-25T12:22:22.809 INFO:teuthology.orchestra.run.smithi117.stdout:fsid 814e11f4-6e34-411d-8202-e91b5ec6cfee 2023-01-25T12:22:22.810 INFO:teuthology.orchestra.run.smithi117.stdout:last_changed 2023-01-25T12:22:22.806750+0000 2023-01-25T12:22:22.810 INFO:teuthology.orchestra.run.smithi117.stdout:created 2023-01-25T12:22:22.806750+0000 2023-01-25T12:22:22.810 INFO:teuthology.orchestra.run.smithi117.stdout:min_mon_release 16 (pacific) 2023-01-25T12:22:22.810 INFO:teuthology.orchestra.run.smithi117.stdout:election_strategy: 1 2023-01-25T12:22:22.810 INFO:teuthology.orchestra.run.smithi117.stdout:0: v1:172.21.15.117:6789/0 mon.a 2023-01-25T12:22:22.811 INFO:teuthology.orchestra.run.smithi117.stdout:1: v1:172.21.15.148:6789/0 mon.b 2023-01-25T12:22:22.811 INFO:teuthology.orchestra.run.smithi117.stdout:2: v1:172.21.15.117:6790/0 mon.c 2023-01-25T12:22:22.811 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-25T12:22:22.812 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T12:22:22.819 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 814e11f4-6e34-411d-8202-e91b5ec6cfee... 2023-01-25T12:22:22.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T12:22:22.864 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T12:22:22.899 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2023-01-25T12:22:22.899 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2023-01-25T12:22:22.899 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T12:22:22.900 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2023-01-25T12:22:22.900 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.900 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2023-01-25T12:22:22.900 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.900 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2023-01-25T12:22:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2023-01-25T12:22:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2023-01-25T12:22:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.901 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2023-01-25T12:22:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2023-01-25T12:22:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T12:22:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2023-01-25T12:22:22.902 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T12:22:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T12:22:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2023-01-25T12:22:22.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2023-01-25T12:22:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2023-01-25T12:22:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2023-01-25T12:22:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2023-01-25T12:22:22.904 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2023-01-25T12:22:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2023-01-25T12:22:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2023-01-25T12:22:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T12:22:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T12:22:22.905 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2023-01-25T12:22:22.906 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.906 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T12:22:22.906 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.906 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2023-01-25T12:22:22.906 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.907 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2023-01-25T12:22:22.907 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.907 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2023-01-25T12:22:22.907 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2023-01-25T12:22:22.907 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2023-01-25T12:22:22.908 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "[v1:172.21.15.117:6789],[v1:172.21.15.117:6790],[v1:172.21.15.148:6789]" 2023-01-25T12:22:22.908 INFO:teuthology.orchestra.run.smithi148.stdout: mon client directed command retry = 5 2023-01-25T12:22:22.908 INFO:teuthology.orchestra.run.smithi148.stdout: mon election default strategy = 1 2023-01-25T12:22:22.908 INFO:teuthology.orchestra.run.smithi148.stdout: ms bind msgr2 = False 2023-01-25T12:22:22.908 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject socket failures = 5000 2023-01-25T12:22:22.909 INFO:teuthology.orchestra.run.smithi148.stdout: ms type = async 2023-01-25T12:22:22.909 INFO:teuthology.orchestra.run.smithi148.stdout: osd_async_recovery_min_cost = 1 2023-01-25T12:22:22.909 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_min_size = 2 2023-01-25T12:22:22.909 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_size = 2 2023-01-25T12:22:22.909 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 814e11f4-6e34-411d-8202-e91b5ec6cfee 2023-01-25T12:22:22.910 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.910 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2023-01-25T12:22:22.910 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2023-01-25T12:22:22.910 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.910 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2023-01-25T12:22:22.911 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 120 2023-01-25T12:22:22.911 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.911 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2023-01-25T12:22:22.911 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2023-01-25T12:22:22.911 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.912 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2023-01-25T12:22:22.912 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2023-01-25T12:22:22.912 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2023-01-25T12:22:22.912 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.912 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2023-01-25T12:22:22.913 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2023-01-25T12:22:22.913 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.913 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2023-01-25T12:22:22.913 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.913 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2023-01-25T12:22:22.913 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.914 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2023-01-25T12:22:22.914 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.914 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2023-01-25T12:22:22.914 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2023-01-25T12:22:22.914 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.915 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2023-01-25T12:22:22.915 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2023-01-25T12:22:22.915 INFO:teuthology.orchestra.run.smithi148.stdout: debug monc = 20 2023-01-25T12:22:22.915 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2023-01-25T12:22:22.916 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore compression algorithm = zstd 2023-01-25T12:22:22.916 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore compression mode = aggressive 2023-01-25T12:22:22.916 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2023-01-25T12:22:22.916 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore zero block detection = True 2023-01-25T12:22:22.916 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 20 2023-01-25T12:22:22.917 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 20 2023-01-25T12:22:22.917 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-01-25T12:22:22.917 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2023-01-25T12:22:22.917 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 10 2023-01-25T12:22:22.917 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T12:22:22.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2023-01-25T12:22:22.918 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2023-01-25T12:22:22.918 INFO:teuthology.orchestra.run.smithi148.stdout: osd blocked scrub grace period = 3600 2023-01-25T12:22:22.918 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug reject backfill probability = 0.3 2023-01-25T12:22:22.918 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify cached snaps = True 2023-01-25T12:22:22.918 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify missing on start = True 2023-01-25T12:22:22.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2023-01-25T12:22:22.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd heartbeat use min delay socket = True 2023-01-25T12:22:22.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd inject bad map crc probability = 0.1 2023-01-25T12:22:22.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd max backfills = 3 2023-01-25T12:22:22.919 INFO:teuthology.orchestra.run.smithi148.stdout: osd max markdown count = 1000 2023-01-25T12:22:22.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock override recovery settings = True 2023-01-25T12:22:22.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2023-01-25T12:22:22.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd op queue = debug_random 2023-01-25T12:22:22.920 INFO:teuthology.orchestra.run.smithi148.stdout: osd op queue cut off = debug_random 2023-01-25T12:22:22.921 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub min interval = 60 2023-01-25T12:22:22.921 INFO:teuthology.orchestra.run.smithi148.stdout: osd shutdown pgref assert = True 2023-01-25T12:22:22.921 INFO:teuthology.orchestra.run.smithi148.stdout: osd snap trim sleep = 2 2023-01-25T12:22:22.921 INFO:teuthology.orchestra.run.smithi148.stdout: osd_max_pg_log_entries = 3000 2023-01-25T12:22:22.922 INFO:teuthology.orchestra.run.smithi148.stdout: osd_min_pg_log_entries = 3000 2023-01-25T12:22:22.922 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.922 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2023-01-25T12:22:22.922 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-01-25T12:22:22.923 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2023-01-25T12:22:22.923 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-01-25T12:22:22.923 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-01-25T12:22:22.923 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-01-25T12:22:22.923 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-01-25T12:22:22.923 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2023-01-25T12:22:22.924 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.924 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2023-01-25T12:22:22.924 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-01-25T12:22:22.924 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-01-25T12:22:22.925 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2023-01-25T12:22:22.925 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-01-25T12:22:22.925 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2023-01-25T12:22:22.925 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2023-01-25T12:22:22.925 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-01-25T12:22:22.925 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2023-01-25T12:22:22.926 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2023-01-25T12:22:22.926 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-01-25T12:22:22.926 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.926 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T12:22:22.926 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T12:22:22.927 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T12:22:22.927 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.927 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T12:22:22.927 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T12:22:22.927 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T12:22:22.928 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.928 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2023-01-25T12:22:22.928 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2023-01-25T12:22:22.928 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.928 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2023-01-25T12:22:22.929 INFO:teuthology.orchestra.run.smithi148.stdout: mon min osdmap epochs = 50 2023-01-25T12:22:22.929 INFO:teuthology.orchestra.run.smithi148.stdout: mon osdmap full prune interval = 2 2023-01-25T12:22:22.929 INFO:teuthology.orchestra.run.smithi148.stdout: mon osdmap full prune min = 15 2023-01-25T12:22:22.929 INFO:teuthology.orchestra.run.smithi148.stdout: mon osdmap full prune txsize = 2 2023-01-25T12:22:22.929 INFO:teuthology.orchestra.run.smithi148.stdout: mon scrub interval = 300 2023-01-25T12:22:22.930 INFO:teuthology.orchestra.run.smithi148.stdout: paxos service trim min = 10 2023-01-25T12:22:22.930 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-01-25T12:22:22.930 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2023-01-25T12:22:22.931 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2023-01-25T12:22:22.931 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2023-01-25T12:22:22.931 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2023-01-25T12:22:22.931 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T12:22:22.932 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T12:22:22.932 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2023-01-25T12:22:22.932 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2023-01-25T12:22:22.932 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2023-01-25T12:22:22.934 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2023-01-25T12:22:22.934 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2023-01-25T12:22:22.934 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T12:22:22.934 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2023-01-25T12:22:22.935 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.935 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2023-01-25T12:22:22.935 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.935 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2023-01-25T12:22:22.935 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.936 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2023-01-25T12:22:22.936 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2023-01-25T12:22:22.936 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.936 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2023-01-25T12:22:22.936 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2023-01-25T12:22:22.937 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.937 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T12:22:22.937 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2023-01-25T12:22:22.937 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.937 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T12:22:22.938 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T12:22:22.938 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.938 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2023-01-25T12:22:22.938 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.938 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2023-01-25T12:22:22.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2023-01-25T12:22:22.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2023-01-25T12:22:22.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2023-01-25T12:22:22.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2023-01-25T12:22:22.939 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2023-01-25T12:22:22.940 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2023-01-25T12:22:22.940 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T12:22:22.940 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T12:22:22.940 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2023-01-25T12:22:22.940 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.941 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T12:22:22.941 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.941 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2023-01-25T12:22:22.941 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.941 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2023-01-25T12:22:22.942 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.942 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2023-01-25T12:22:22.942 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2023-01-25T12:22:22.942 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2023-01-25T12:22:22.942 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "[v1:172.21.15.117:6789],[v1:172.21.15.117:6790],[v1:172.21.15.148:6789]" 2023-01-25T12:22:22.942 INFO:teuthology.orchestra.run.smithi117.stdout: mon client directed command retry = 5 2023-01-25T12:22:22.943 INFO:teuthology.orchestra.run.smithi117.stdout: mon election default strategy = 1 2023-01-25T12:22:22.943 INFO:teuthology.orchestra.run.smithi117.stdout: ms bind msgr2 = False 2023-01-25T12:22:22.943 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject socket failures = 5000 2023-01-25T12:22:22.943 INFO:teuthology.orchestra.run.smithi117.stdout: ms type = async 2023-01-25T12:22:22.943 INFO:teuthology.orchestra.run.smithi117.stdout: osd_async_recovery_min_cost = 1 2023-01-25T12:22:22.944 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_min_size = 2 2023-01-25T12:22:22.944 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_size = 2 2023-01-25T12:22:22.944 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 814e11f4-6e34-411d-8202-e91b5ec6cfee 2023-01-25T12:22:22.944 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.945 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2023-01-25T12:22:22.945 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2023-01-25T12:22:22.945 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.945 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2023-01-25T12:22:22.945 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 120 2023-01-25T12:22:22.946 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.946 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2023-01-25T12:22:22.946 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2023-01-25T12:22:22.946 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.946 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2023-01-25T12:22:22.947 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2023-01-25T12:22:22.947 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2023-01-25T12:22:22.947 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.947 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2023-01-25T12:22:22.947 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2023-01-25T12:22:22.948 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.948 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2023-01-25T12:22:22.948 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.948 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2023-01-25T12:22:22.948 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.949 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2023-01-25T12:22:22.949 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.949 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2023-01-25T12:22:22.949 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2023-01-25T12:22:22.949 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.950 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2023-01-25T12:22:22.950 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2023-01-25T12:22:22.950 INFO:teuthology.orchestra.run.smithi117.stdout: debug monc = 20 2023-01-25T12:22:22.950 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2023-01-25T12:22:22.950 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore compression algorithm = zstd 2023-01-25T12:22:22.951 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore compression mode = aggressive 2023-01-25T12:22:22.951 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2023-01-25T12:22:22.951 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore zero block detection = True 2023-01-25T12:22:22.951 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2023-01-25T12:22:22.951 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2023-01-25T12:22:22.951 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-01-25T12:22:22.952 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2023-01-25T12:22:22.952 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2023-01-25T12:22:22.952 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T12:22:22.952 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2023-01-25T12:22:22.952 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2023-01-25T12:22:22.953 INFO:teuthology.orchestra.run.smithi117.stdout: osd blocked scrub grace period = 3600 2023-01-25T12:22:22.953 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug reject backfill probability = 0.3 2023-01-25T12:22:22.953 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify cached snaps = True 2023-01-25T12:22:22.953 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify missing on start = True 2023-01-25T12:22:22.953 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2023-01-25T12:22:22.954 INFO:teuthology.orchestra.run.smithi117.stdout: osd heartbeat use min delay socket = True 2023-01-25T12:22:22.954 INFO:teuthology.orchestra.run.smithi117.stdout: osd inject bad map crc probability = 0.1 2023-01-25T12:22:22.954 INFO:teuthology.orchestra.run.smithi117.stdout: osd max backfills = 3 2023-01-25T12:22:22.954 INFO:teuthology.orchestra.run.smithi117.stdout: osd max markdown count = 1000 2023-01-25T12:22:22.954 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock override recovery settings = True 2023-01-25T12:22:22.955 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2023-01-25T12:22:22.955 INFO:teuthology.orchestra.run.smithi117.stdout: osd op queue = debug_random 2023-01-25T12:22:22.955 INFO:teuthology.orchestra.run.smithi117.stdout: osd op queue cut off = debug_random 2023-01-25T12:22:22.955 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub min interval = 60 2023-01-25T12:22:22.955 INFO:teuthology.orchestra.run.smithi117.stdout: osd shutdown pgref assert = True 2023-01-25T12:22:22.956 INFO:teuthology.orchestra.run.smithi117.stdout: osd snap trim sleep = 2 2023-01-25T12:22:22.956 INFO:teuthology.orchestra.run.smithi117.stdout: osd_max_pg_log_entries = 3000 2023-01-25T12:22:22.956 INFO:teuthology.orchestra.run.smithi117.stdout: osd_min_pg_log_entries = 3000 2023-01-25T12:22:22.956 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.956 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2023-01-25T12:22:22.957 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-01-25T12:22:22.957 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2023-01-25T12:22:22.957 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-01-25T12:22:22.957 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-01-25T12:22:22.957 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-01-25T12:22:22.958 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-01-25T12:22:22.958 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2023-01-25T12:22:22.958 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.958 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2023-01-25T12:22:22.958 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-01-25T12:22:22.959 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-01-25T12:22:22.959 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2023-01-25T12:22:22.959 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-01-25T12:22:22.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2023-01-25T12:22:22.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2023-01-25T12:22:22.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-01-25T12:22:22.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2023-01-25T12:22:22.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2023-01-25T12:22:22.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-01-25T12:22:22.960 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.961 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T12:22:22.961 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T12:22:22.961 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T12:22:22.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.961 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T12:22:22.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T12:22:22.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T12:22:22.962 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.962 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2023-01-25T12:22:22.962 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2023-01-25T12:22:22.963 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.963 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2023-01-25T12:22:22.963 INFO:teuthology.orchestra.run.smithi117.stdout: mon min osdmap epochs = 50 2023-01-25T12:22:22.963 INFO:teuthology.orchestra.run.smithi117.stdout: mon osdmap full prune interval = 2 2023-01-25T12:22:22.963 INFO:teuthology.orchestra.run.smithi117.stdout: mon osdmap full prune min = 15 2023-01-25T12:22:22.964 INFO:teuthology.orchestra.run.smithi117.stdout: mon osdmap full prune txsize = 2 2023-01-25T12:22:22.964 INFO:teuthology.orchestra.run.smithi117.stdout: mon scrub interval = 300 2023-01-25T12:22:22.964 INFO:teuthology.orchestra.run.smithi117.stdout: paxos service trim min = 10 2023-01-25T12:22:22.964 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:22:22.964 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2023-01-25T12:22:22.965 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2023-01-25T12:22:22.965 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2023-01-25T12:22:22.965 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2023-01-25T12:22:22.965 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T12:22:22.965 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T12:22:22.966 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2023-01-25T12:22:22.966 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2023-01-25T12:22:22.966 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2023-01-25T12:22:22.966 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-25T12:22:22.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-25T12:22:23.022 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-25T12:22:23.022 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:23.022 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-25T12:22:23.030 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:23.030 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-25T12:22:23.037 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2023-01-25T12:22:23.037 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:23.037 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T12:22:23.038 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T12:22:23.060 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:23.061 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:23.109 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2023-01-25T12:22:23.109 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:23.110 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T12:22:23.110 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T12:22:23.136 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:23.137 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:23.186 INFO:tasks.ceph:Setting up mon nodes... 2023-01-25T12:22:23.187 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-25T12:22:23.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T12:22:23.240 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T12:22:23.243 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T12:22:23.296 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T12:22:23.306 INFO:tasks.ceph:Setting up mds nodes... 2023-01-25T12:22:23.307 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-25T12:22:23.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-25T12:22:23.348 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-25T12:22:23.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-25T12:22:23.403 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-25T12:22:23.416 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-25T12:22:23.417 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T12:22:23.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-25T12:22:23.433 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:23.434 INFO:tasks.ceph:role: osd.0 2023-01-25T12:22:23.434 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2023-01-25T12:22:23.434 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T12:22:23.964 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T12:22:23.964 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T12:22:23.964 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T12:22:23.965 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 2023-01-25T12:22:23.965 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T12:22:23.965 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-01-25T12:22:23.965 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T12:22:23.965 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T12:22:23.965 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T12:22:23.966 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T12:22:23.967 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-01-25T12:22:23.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-25T12:22:24.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-25T12:22:24.063 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T12:22:24.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:22:24.065 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-25T12:22:24.075 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:24.075 INFO:tasks.ceph:role: osd.1 2023-01-25T12:22:24.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2023-01-25T12:22:24.076 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T12:22:24.635 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T12:22:24.635 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T12:22:24.636 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T12:22:24.636 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 2023-01-25T12:22:24.636 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T12:22:24.636 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-01-25T12:22:24.636 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T12:22:24.637 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T12:22:24.637 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T12:22:24.637 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T12:22:24.638 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-01-25T12:22:24.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-25T12:22:24.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-25T12:22:24.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:22:24.685 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T12:22:24.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-25T12:22:24.743 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:24.743 INFO:tasks.ceph:role: osd.2 2023-01-25T12:22:24.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2023-01-25T12:22:24.744 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T12:22:25.204 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T12:22:25.205 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T12:22:25.205 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T12:22:25.205 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 2023-01-25T12:22:25.205 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T12:22:25.206 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-01-25T12:22:25.206 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T12:22:25.206 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T12:22:25.206 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T12:22:25.206 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T12:22:25.207 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-01-25T12:22:25.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-25T12:22:25.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-25T12:22:25.303 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T12:22:25.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:22:25.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-25T12:22:25.315 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:25.315 INFO:tasks.ceph:role: osd.3 2023-01-25T12:22:25.316 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2023-01-25T12:22:25.316 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T12:22:25.796 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T12:22:25.797 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T12:22:25.797 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T12:22:25.797 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 2023-01-25T12:22:25.797 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T12:22:25.798 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-01-25T12:22:25.798 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T12:22:25.798 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T12:22:25.798 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T12:22:25.798 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T12:22:25.799 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-01-25T12:22:25.800 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-25T12:22:25.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-25T12:22:25.878 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T12:22:25.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:22:25.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:25.952 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:25.947+0000 7fecc0192640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-25T12:22:25.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:25.947+0000 7fecc0192640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-25T12:22:25.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:25.947+0000 7fecc0192640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T12:22:25.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:25.947+0000 7fecc0192640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T12:22:25.953 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:25.947+0000 7fecc0192640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T12:22:25.954 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:25.947+0000 7fecc0192640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-25T12:22:26.763 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:26.759+0000 7fecc0192640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:27.539 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:27.531+0000 7fecc0192640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:28.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:28.319+0000 7fecc0192640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:29.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-25T12:22:29.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:29.305 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:29.299+0000 7f054cf53640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-25T12:22:29.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:29.299+0000 7f054cf53640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-25T12:22:29.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:29.299+0000 7f054cf53640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T12:22:29.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:29.299+0000 7f054cf53640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T12:22:29.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:29.299+0000 7f054cf53640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T12:22:29.306 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:29.299+0000 7f054cf53640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-25T12:22:29.870 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:29.863+0000 7f054cf53640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:30.659 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:30.651+0000 7f054cf53640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:31.449 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:31.443+0000 7f054cf53640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:32.294 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-25T12:22:32.312 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:32.359 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:32.351+0000 7efe03620640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-25T12:22:32.360 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:32.355+0000 7efe03620640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-25T12:22:32.360 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:32.355+0000 7efe03620640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T12:22:32.360 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:32.355+0000 7efe03620640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T12:22:32.360 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:32.355+0000 7efe03620640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T12:22:32.361 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:32.355+0000 7efe03620640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-25T12:22:32.915 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:32.911+0000 7efe03620640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:33.704 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:33.699+0000 7efe03620640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:34.498 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:34.491+0000 7efe03620640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:35.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-25T12:22:35.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:35.466 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:35.459+0000 7f3e9bec1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-25T12:22:35.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:35.459+0000 7f3e9bec1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-25T12:22:35.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:35.459+0000 7f3e9bec1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T12:22:35.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:35.459+0000 7f3e9bec1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T12:22:35.467 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:35.459+0000 7f3e9bec1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T12:22:35.468 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:35.463+0000 7f3e9bec1640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-25T12:22:36.035 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:36.027+0000 7f3e9bec1640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:36.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:36.807+0000 7f3e9bec1640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:37.605 INFO:teuthology.orchestra.run.smithi117.stderr:2023-01-25T12:22:37.599+0000 7f3e9bec1640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:38.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-25T12:22:38.484 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-25T12:22:38.502 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:38.502 INFO:tasks.ceph:role: osd.4 2023-01-25T12:22:38.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2023-01-25T12:22:38.503 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T12:22:39.034 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T12:22:39.034 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T12:22:39.034 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T12:22:39.035 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-01-25T12:22:39.035 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T12:22:39.035 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-01-25T12:22:39.035 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T12:22:39.035 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T12:22:39.036 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T12:22:39.036 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T12:22:39.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-01-25T12:22:39.037 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-25T12:22:39.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-25T12:22:39.142 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T12:22:39.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:22:39.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-25T12:22:39.200 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:39.200 INFO:tasks.ceph:role: osd.5 2023-01-25T12:22:39.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2023-01-25T12:22:39.201 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T12:22:39.698 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T12:22:39.699 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T12:22:39.699 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T12:22:39.699 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-01-25T12:22:39.699 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T12:22:39.700 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-01-25T12:22:39.700 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T12:22:39.700 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T12:22:39.700 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T12:22:39.700 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T12:22:39.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-01-25T12:22:39.702 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-25T12:22:39.735 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-25T12:22:39.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:22:39.747 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T12:22:39.748 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-25T12:22:39.802 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:39.802 INFO:tasks.ceph:role: osd.6 2023-01-25T12:22:39.802 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2023-01-25T12:22:39.803 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T12:22:40.270 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T12:22:40.270 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T12:22:40.270 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T12:22:40.271 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-01-25T12:22:40.271 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T12:22:40.271 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-01-25T12:22:40.271 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T12:22:40.271 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T12:22:40.272 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T12:22:40.272 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T12:22:40.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-01-25T12:22:40.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-25T12:22:40.337 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-25T12:22:40.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:22:40.349 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T12:22:40.349 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-25T12:22:40.361 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T12:22:40.361 INFO:tasks.ceph:role: osd.7 2023-01-25T12:22:40.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2023-01-25T12:22:40.362 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T12:22:40.877 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T12:22:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T12:22:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T12:22:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-01-25T12:22:40.878 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T12:22:40.878 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-01-25T12:22:40.878 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T12:22:40.879 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T12:22:40.879 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T12:22:40.879 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T12:22:40.880 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-01-25T12:22:40.880 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-25T12:22:40.940 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-25T12:22:40.953 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T12:22:40.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T12:22:40.955 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:41.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:41.020+0000 7f44e4386640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-25T12:22:41.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:41.024+0000 7f44e4386640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-25T12:22:41.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:41.024+0000 7f44e4386640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T12:22:41.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:41.024+0000 7f44e4386640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T12:22:41.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:41.024+0000 7f44e4386640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T12:22:41.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:41.028+0000 7f44e4386640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-25T12:22:41.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:41.836+0000 7f44e4386640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:42.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:42.616+0000 7f44e4386640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:43.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:43.400+0000 7f44e4386640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:44.264 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-25T12:22:44.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:44.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:44.364+0000 7f28e5c2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-25T12:22:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:44.364+0000 7f28e5c2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-25T12:22:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:44.364+0000 7f28e5c2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T12:22:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:44.364+0000 7f28e5c2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T12:22:44.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:44.364+0000 7f28e5c2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T12:22:44.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:44.364+0000 7f28e5c2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-25T12:22:44.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:44.940+0000 7f28e5c2b640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:45.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:45.720+0000 7f28e5c2b640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:46.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:46.508+0000 7f28e5c2b640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:47.367 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-25T12:22:47.385 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:47.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:47.424+0000 7f2fdd5b7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-25T12:22:47.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:47.424+0000 7f2fdd5b7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-25T12:22:47.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:47.424+0000 7f2fdd5b7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T12:22:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:47.424+0000 7f2fdd5b7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T12:22:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:47.424+0000 7f2fdd5b7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T12:22:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:47.424+0000 7f2fdd5b7640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-01-25T12:22:47.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:47.988+0000 7f2fdd5b7640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:48.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:48.764+0000 7f2fdd5b7640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:49.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:49.548+0000 7f2fdd5b7640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:50.410 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-25T12:22:50.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:50.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:50.508+0000 7f07589ea640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-25T12:22:50.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:50.508+0000 7f07589ea640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-25T12:22:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:50.508+0000 7f07589ea640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T12:22:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:50.508+0000 7f07589ea640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T12:22:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:50.508+0000 7f07589ea640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T12:22:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:50.512+0000 7f07589ea640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-01-25T12:22:51.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:51.084+0000 7f07589ea640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:51.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:51.872+0000 7f07589ea640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:52.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-01-25T12:22:52.676+0000 7f07589ea640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T12:22:53.546 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-25T12:22:53.562 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-25T12:22:53.562 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:53.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-25T12:22:53.580 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:53.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-25T12:22:53.596 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:53.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-25T12:22:53.653 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:53.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-25T12:22:53.667 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:53.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-25T12:22:53.678 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:53.679 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-25T12:22:53.695 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:53.696 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-25T12:22:53.752 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:53.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-25T12:22:53.762 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:53.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-25T12:22:53.820 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:53.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-25T12:22:53.830 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:22:53.830 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-25T12:22:53.838 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:22:53.839 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-25T12:22:53.845 INFO:tasks.ceph:Adding keys to all mons... 2023-01-25T12:22:53.845 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T12:22:53.848 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T12:22:53.891 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2023-01-25T12:22:53.891 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD/HtFjonxBDhAAQ4hbl7iYWUKrDi8DwK+kXg== 2023-01-25T12:22:53.891 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2023-01-25T12:22:53.892 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQABH9FjnEyvOBAAPQUGRhHqInfAse30LHVb+Q== 2023-01-25T12:22:53.892 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2023-01-25T12:22:53.892 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAFH9Fjc9QKEhAA4zPd7MJ/By4yScDzXXRJYw== 2023-01-25T12:22:53.892 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2023-01-25T12:22:53.892 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAIH9FjMyVYFRAAp6HXyU5lwtoLwf/l2FSGZA== 2023-01-25T12:22:53.893 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2023-01-25T12:22:53.893 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQALH9FjpkK6GxAAkbJ028AX3W7i/8fIBit8gQ== 2023-01-25T12:22:53.893 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2023-01-25T12:22:53.893 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD/HtFjPySfERAAQgv3tStkkpWFi0GtsP+mBQ== 2023-01-25T12:22:53.894 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2023-01-25T12:22:53.894 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQARH9FjkjuSARAAlY/ntVNRmFYqoTmzS7qWoQ== 2023-01-25T12:22:53.894 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2023-01-25T12:22:53.894 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAUH9Fjh/UFFhAAoSblZTBc9OpzTrWysV+LNw== 2023-01-25T12:22:53.895 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2023-01-25T12:22:53.895 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAXH9FjE5WVGRAAZnH9k6JCSI3bJNw76XwuXA== 2023-01-25T12:22:53.896 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2023-01-25T12:22:53.896 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAaH9FjqHC1HhAAp040ZmZQhhoXLDxs+7XnLA== 2023-01-25T12:22:53.897 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2023-01-25T12:22:53.897 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD/HtFjRvGxFBAAyawblQUdaCuydlhVxcB73Q== 2023-01-25T12:22:53.897 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2023-01-25T12:22:53.897 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD/HtFjoNQDGBAA27+4viaj0UXjME/ZouEskQ== 2023-01-25T12:22:53.902 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2023-01-25T12:22:53.902 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQD/HtFjonxBDhAAQ4hbl7iYWUKrDi8DwK+kXg== 2023-01-25T12:22:53.903 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2023-01-25T12:22:53.903 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQABH9FjnEyvOBAAPQUGRhHqInfAse30LHVb+Q== 2023-01-25T12:22:53.903 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2023-01-25T12:22:53.903 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQAFH9Fjc9QKEhAA4zPd7MJ/By4yScDzXXRJYw== 2023-01-25T12:22:53.903 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2023-01-25T12:22:53.904 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQAIH9FjMyVYFRAAp6HXyU5lwtoLwf/l2FSGZA== 2023-01-25T12:22:53.904 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2023-01-25T12:22:53.904 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQALH9FjpkK6GxAAkbJ028AX3W7i/8fIBit8gQ== 2023-01-25T12:22:53.904 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2023-01-25T12:22:53.904 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQD/HtFjPySfERAAQgv3tStkkpWFi0GtsP+mBQ== 2023-01-25T12:22:53.905 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2023-01-25T12:22:53.905 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQARH9FjkjuSARAAlY/ntVNRmFYqoTmzS7qWoQ== 2023-01-25T12:22:53.905 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2023-01-25T12:22:53.905 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQAUH9Fjh/UFFhAAoSblZTBc9OpzTrWysV+LNw== 2023-01-25T12:22:53.905 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2023-01-25T12:22:53.906 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQAXH9FjE5WVGRAAZnH9k6JCSI3bJNw76XwuXA== 2023-01-25T12:22:53.906 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2023-01-25T12:22:53.906 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQAaH9FjqHC1HhAAp040ZmZQhhoXLDxs+7XnLA== 2023-01-25T12:22:53.906 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2023-01-25T12:22:53.906 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQD/HtFjRvGxFBAAyawblQUdaCuydlhVxcB73Q== 2023-01-25T12:22:53.907 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2023-01-25T12:22:53.907 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQD/HtFjoNQDGBAA27+4viaj0UXjME/ZouEskQ== 2023-01-25T12:22:53.908 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T12:22:53.941 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T12:22:53.989 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:53.992 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T12:22:54.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T12:22:54.324 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.327 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.417 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.470 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.517 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T12:22:54.607 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T12:22:54.611 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T12:22:54.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T12:22:54.663 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T12:22:54.715 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-25T12:22:54.715 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-25T12:22:54.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T12:22:54.790 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-25T12:22:54.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-25T12:22:54.859 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T12:22:54.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-25T12:22:54.935 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-25T12:22:54.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T12:22:55.066 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-25T12:22:55.081 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:55.084 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T12:22:55.089 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-25T12:22:55.089 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-25T12:22:55.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-25T12:22:55.132 INFO:tasks.ceph.mon.a:Started 2023-01-25T12:22:55.133 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-25T12:22:55.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-25T12:22:55.135 INFO:tasks.ceph.mon.c:Started 2023-01-25T12:22:55.136 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-25T12:22:55.136 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-25T12:22:55.138 INFO:tasks.ceph.mon.b:Started 2023-01-25T12:22:55.139 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-25T12:22:55.139 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-25T12:22:55.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-25T12:22:55.143 INFO:tasks.ceph.mgr.y:Started 2023-01-25T12:22:55.143 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-25T12:22:55.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-25T12:22:55.146 INFO:tasks.ceph.mgr.x:Started 2023-01-25T12:22:55.147 INFO:tasks.ceph:Setting crush tunables to default 2023-01-25T12:22:55.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd crush tunables default 2023-01-25T12:23:00.605 INFO:teuthology.orchestra.run.smithi117.stderr:adjusted tunables profile to default 2023-01-25T12:23:00.616 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-25T12:23:00.616 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:23:00.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-25T12:23:00.626 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:23:00.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-25T12:23:00.637 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:23:00.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-25T12:23:00.647 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-01-25T12:23:00.647 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-25T12:23:00.657 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:23:00.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-25T12:23:00.672 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:00.666+0000 7f1e17de32c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T12:23:00.675 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:23:00.675 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-25T12:23:00.730 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:23:00.730 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-25T12:23:00.739 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-01-25T12:23:00.740 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-25T12:23:00.750 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 68adfa07-6535-47c4-8201-28ea95fbc9ca 0 2023-01-25T12:23:00.766 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:00.763+0000 7ff4bce192c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T12:23:00.951 INFO:teuthology.orchestra.run.smithi148.stdout:0 2023-01-25T12:23:00.966 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 408c3819-f2b1-4e02-bca2-533176953430 1 2023-01-25T12:23:01.220 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-01-25T12:23:01.235 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 413eac7e-c4a5-4da6-9adb-45021d8a7e34 2 2023-01-25T12:23:01.289 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:01.282+0000 7f1e17de32c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T12:23:01.347 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:01.338+0000 7f1e17de32c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T12:23:01.382 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:01.379+0000 7ff4bce192c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T12:23:01.439 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:01.435+0000 7ff4bce192c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T12:23:01.440 INFO:teuthology.orchestra.run.smithi148.stdout:2 2023-01-25T12:23:01.454 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new ddca42d1-70ca-415f-bde3-1e3169f8ce81 3 2023-01-25T12:23:01.463 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:01.458+0000 7f1e17de32c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T12:23:01.556 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:01.555+0000 7ff4bce192c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T12:23:01.664 INFO:teuthology.orchestra.run.smithi148.stdout:3 2023-01-25T12:23:01.681 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 82366822-5d13-4c35-97ae-065f115f107b 4 2023-01-25T12:23:01.690 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:01.682+0000 7f1e17de32c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T12:23:01.738 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:01.730+0000 7f1e17de32c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T12:23:01.781 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:01.779+0000 7ff4bce192c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T12:23:01.828 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:01.827+0000 7ff4bce192c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T12:23:01.892 INFO:teuthology.orchestra.run.smithi148.stdout:4 2023-01-25T12:23:01.907 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new e09c9352-5d33-4e18-978e-4af5b0ff771e 5 2023-01-25T12:23:01.912 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:01.906+0000 7f1e17de32c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T12:23:01.972 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:01.966+0000 7f1e17de32c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T12:23:02.000 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:01.999+0000 7ff4bce192c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T12:23:02.033 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:02.026+0000 7f1e17de32c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T12:23:02.061 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:02.059+0000 7ff4bce192c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T12:23:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:5 2023-01-25T12:23:02.122 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:02.119+0000 7ff4bce192c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T12:23:02.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 3331e9a0-bf3a-4eff-b876-56b4bb973349 6 2023-01-25T12:23:02.327 INFO:teuthology.orchestra.run.smithi148.stdout:6 2023-01-25T12:23:02.340 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new d77ce8ca-2885-4567-b2e1-2d74433e3bbf 7 2023-01-25T12:23:02.418 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:02.410+0000 7f1e17de32c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T12:23:02.529 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:02.527+0000 7ff4bce192c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T12:23:02.542 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:02.534+0000 7f1e17de32c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T12:23:02.544 INFO:teuthology.orchestra.run.smithi148.stdout:7 2023-01-25T12:23:02.558 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-25T12:23:02.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-25T12:23:02.561 INFO:tasks.ceph.osd.0:Started 2023-01-25T12:23:02.561 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-25T12:23:02.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-25T12:23:02.563 INFO:tasks.ceph.osd.1:Started 2023-01-25T12:23:02.564 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-25T12:23:02.564 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-25T12:23:02.566 INFO:tasks.ceph.osd.2:Started 2023-01-25T12:23:02.567 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-25T12:23:02.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-25T12:23:02.569 INFO:tasks.ceph.osd.3:Started 2023-01-25T12:23:02.570 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-25T12:23:02.570 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-25T12:23:02.573 INFO:tasks.ceph.osd.4:Started 2023-01-25T12:23:02.573 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-25T12:23:02.573 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-25T12:23:02.575 INFO:tasks.ceph.osd.5:Started 2023-01-25T12:23:02.576 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-25T12:23:02.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-25T12:23:02.578 INFO:tasks.ceph.osd.6:Started 2023-01-25T12:23:02.578 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-25T12:23:02.579 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-25T12:23:02.580 INFO:tasks.ceph.osd.7:Started 2023-01-25T12:23:02.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T12:23:02.664 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:02.659+0000 7ff4bce192c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T12:23:02.779 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:02.780 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":10,"fsid":"814e11f4-6e34-411d-8202-e91b5ec6cfee","created":"2023-01-25T12:23:00.478907+0000","modified":"2023-01-25T12:23:02.537193+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T12:23:02.537193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"68adfa07-6535-47c4-8201-28ea95fbc9ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"408c3819-f2b1-4e02-bca2-533176953430","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"413eac7e-c4a5-4da6-9adb-45021d8a7e34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ddca42d1-70ca-415f-bde3-1e3169f8ce81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82366822-5d13-4c35-97ae-065f115f107b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e09c9352-5d33-4e18-978e-4af5b0ff771e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3331e9a0-bf3a-4eff-b876-56b4bb973349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d77ce8ca-2885-4567-b2e1-2d74433e3bbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T12:23:02.797 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-25T12:23:02.797 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-25T12:23:02.898 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:02.890+0000 7f1e17de32c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T12:23:02.945 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-01-25T12:23:02.938+0000 7faa1460c640 -1 Falling back to public interface 2023-01-25T12:23:02.952 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-01-25T12:23:02.946+0000 7f5e82b97640 -1 Falling back to public interface 2023-01-25T12:23:02.956 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:02.951+0000 7ff4bce192c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T12:23:02.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-01-25T12:23:02.950+0000 7fc408196640 -1 Falling back to public interface 2023-01-25T12:23:03.077 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:03.070+0000 7f1e17de32c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T12:23:03.118 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:03.115+0000 7ff4bce192c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T12:23:03.151 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:03.142+0000 7f1e17de32c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T12:23:03.184 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:03.179+0000 7ff4bce192c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T12:23:03.198 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-01-25T12:23:03.195+0000 7f21ae78d640 -1 Falling back to public interface 2023-01-25T12:23:03.205 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-01-25T12:23:03.198+0000 7feef9fb3640 -1 Falling back to public interface 2023-01-25T12:23:03.206 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:03.198+0000 7f1e17de32c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T12:23:03.213 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-01-25T12:23:03.211+0000 7fa7be670640 -1 Falling back to public interface 2023-01-25T12:23:03.225 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-01-25T12:23:03.223+0000 7f605c0a1640 -1 Falling back to public interface 2023-01-25T12:23:03.226 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-01-25T12:23:03.223+0000 7f9bd6f19640 -1 Falling back to public interface 2023-01-25T12:23:03.237 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:03.235+0000 7ff4bce192c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T12:23:03.605 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T12:23:03.794 INFO:teuthology.misc.health.smithi117.stdout: 2023-01-25T12:23:03.795 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":10,"fsid":"814e11f4-6e34-411d-8202-e91b5ec6cfee","created":"2023-01-25T12:23:00.478907+0000","modified":"2023-01-25T12:23:02.537193+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T12:23:02.537193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"68adfa07-6535-47c4-8201-28ea95fbc9ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"408c3819-f2b1-4e02-bca2-533176953430","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"413eac7e-c4a5-4da6-9adb-45021d8a7e34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ddca42d1-70ca-415f-bde3-1e3169f8ce81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82366822-5d13-4c35-97ae-065f115f107b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e09c9352-5d33-4e18-978e-4af5b0ff771e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3331e9a0-bf3a-4eff-b876-56b4bb973349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d77ce8ca-2885-4567-b2e1-2d74433e3bbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T12:23:03.806 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-25T12:23:04.019 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:04.010+0000 7f1e17de32c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T12:23:04.084 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:04.078+0000 7f1e17de32c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T12:23:04.116 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:04.115+0000 7ff4bce192c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T12:23:04.178 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:04.175+0000 7ff4bce192c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T12:23:04.262 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:04.254+0000 7f1e17de32c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T12:23:04.327 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:04.318+0000 7f1e17de32c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T12:23:04.358 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:04.355+0000 7ff4bce192c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T12:23:04.400 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:04.394+0000 7f1e17de32c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T12:23:04.424 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:04.423+0000 7ff4bce192c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T12:23:04.494 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:04.491+0000 7ff4bce192c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T12:23:04.576 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:04.570+0000 7f1e17de32c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T12:23:04.649 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:04.642+0000 7f1e17de32c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T12:23:04.668 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:04.663+0000 7ff4bce192c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T12:23:04.740 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:04.735+0000 7ff4bce192c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T12:23:05.462 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:05.454+0000 7f1e17de32c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T12:23:05.538 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-01-25T12:23:05.535+0000 7ff4bce192c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T12:23:06.349 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-01-25T12:23:06.347+0000 7f21ae78d640 -1 osd.7 0 log_to_monitors true 2023-01-25T12:23:06.499 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:06.490+0000 7f1dff3b0700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-25T12:23:06.504 INFO:tasks.ceph.mgr.y.smithi117.stderr:2023-01-25T12:23:06.498+0000 7f1dff3b0700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-25T12:23:06.531 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-01-25T12:23:06.522+0000 7f5e82b97640 -1 osd.0 0 log_to_monitors true 2023-01-25T12:23:06.766 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-01-25T12:23:06.758+0000 7faa1460c640 -1 osd.2 0 log_to_monitors true 2023-01-25T12:23:06.843 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-01-25T12:23:06.839+0000 7f9bd6f19640 -1 osd.5 0 log_to_monitors true 2023-01-25T12:23:06.852 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-01-25T12:23:06.851+0000 7f605c0a1640 -1 osd.6 0 log_to_monitors true 2023-01-25T12:23:06.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-01-25T12:23:06.930+0000 7fc408196640 -1 osd.1 0 log_to_monitors true 2023-01-25T12:23:07.053 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-01-25T12:23:07.046+0000 7feef9fb3640 -1 osd.3 0 log_to_monitors true 2023-01-25T12:23:07.082 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-01-25T12:23:07.079+0000 7fa7be670640 -1 osd.4 0 log_to_monitors true 2023-01-25T12:23:08.253 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-01-25T12:23:08.251+0000 7f21aa5ca700 -1 osd.7 0 waiting for initial osdmap 2023-01-25T12:23:08.254 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-01-25T12:23:08.246+0000 7faa10449700 -1 osd.2 0 waiting for initial osdmap 2023-01-25T12:23:08.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-01-25T12:23:08.246+0000 7fc403fd3700 -1 osd.1 0 waiting for initial osdmap 2023-01-25T12:23:08.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-01-25T12:23:08.254+0000 7fc3f9836700 -1 osd.1 0 handle_osd_map injecting map crc failure 2023-01-25T12:23:08.261 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-01-25T12:23:08.254+0000 7faa05cac700 -1 osd.2 0 handle_osd_map injecting map crc failure 2023-01-25T12:23:08.262 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-01-25T12:23:08.259+0000 7f9bd2d56700 -1 osd.5 0 waiting for initial osdmap 2023-01-25T12:23:08.262 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-01-25T12:23:08.259+0000 7f6057ede700 -1 osd.6 0 waiting for initial osdmap 2023-01-25T12:23:08.262 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-01-25T12:23:08.259+0000 7fa7ba4ad700 -1 osd.4 0 waiting for initial osdmap 2023-01-25T12:23:08.263 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-01-25T12:23:08.259+0000 7fa7afd10700 -1 osd.4 0 handle_osd_map injecting map crc failure 2023-01-25T12:23:08.264 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-01-25T12:23:08.254+0000 7feef5df0700 -1 osd.3 0 waiting for initial osdmap 2023-01-25T12:23:08.264 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-01-25T12:23:08.254+0000 7feeeb653700 -1 osd.3 0 handle_osd_map injecting map crc failure 2023-01-25T12:23:08.264 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-01-25T12:23:08.259+0000 7f219fe2d700 -1 osd.7 0 handle_osd_map injecting map crc failure 2023-01-25T12:23:08.265 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-01-25T12:23:08.258+0000 7f5e7e9d4700 -1 osd.0 0 waiting for initial osdmap 2023-01-25T12:23:08.265 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-01-25T12:23:08.258+0000 7f5e74237700 -1 osd.0 0 handle_osd_map injecting map crc failure 2023-01-25T12:23:08.266 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-01-25T12:23:08.258+0000 7faa0bf00700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T12:23:08.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2023-01-25T12:23:08.258+0000 7fc3ffa8a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T12:23:08.267 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-01-25T12:23:08.263+0000 7f9bc85b9700 -1 osd.5 0 handle_osd_map injecting map crc failure 2023-01-25T12:23:08.268 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-01-25T12:23:08.258+0000 7feef18a7700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T12:23:08.268 INFO:tasks.ceph.osd.0.smithi117.stderr:2023-01-25T12:23:08.262+0000 7f5e7a48b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T12:23:08.269 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-01-25T12:23:08.267+0000 7f21a6081700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T12:23:08.270 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-01-25T12:23:08.267+0000 7fa7b5f64700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T12:23:08.270 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-01-25T12:23:08.267+0000 7f6053995700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T12:23:08.272 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-01-25T12:23:08.271+0000 7f9bce80d700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T12:23:10.358 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-01-25T12:23:10.355+0000 7f219fe2d700 -1 osd.7 13 handle_osd_map injecting map crc failure 2023-01-25T12:23:10.613 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T12:23:10.901 INFO:teuthology.misc.health.smithi117.stdout: 2023-01-25T12:23:10.901 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":14,"fsid":"814e11f4-6e34-411d-8202-e91b5ec6cfee","created":"2023-01-25T12:23:00.478907+0000","modified":"2023-01-25T12:23:10.267067+0000","last_up_change":"2023-01-25T12:23:09.251087+0000","last_in_change":"2023-01-25T12:23:02.537193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T12:23:09.555417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"68adfa07-6535-47c4-8201-28ea95fbc9ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6804","nonce":27954}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6805","nonce":27954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6807","nonce":27954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6806","nonce":27954}]},"public_addr":"172.21.15.117:6804/27954","cluster_addr":"172.21.15.117:6805/27954","heartbeat_back_addr":"172.21.15.117:6807/27954","heartbeat_front_addr":"172.21.15.117:6806/27954","state":["exists","up"]},{"osd":1,"uuid":"408c3819-f2b1-4e02-bca2-533176953430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6808","nonce":27955}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6809","nonce":27955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6811","nonce":27955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6810","nonce":27955}]},"public_addr":"172.21.15.117:6808/27955","cluster_addr":"172.21.15.117:6809/27955","heartbeat_back_addr":"172.21.15.117:6811/27955","heartbeat_front_addr":"172.21.15.117:6810/27955","state":["exists","up"]},{"osd":2,"uuid":"413eac7e-c4a5-4da6-9adb-45021d8a7e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6800","nonce":27953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6801","nonce":27953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6803","nonce":27953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6802","nonce":27953}]},"public_addr":"172.21.15.117:6800/27953","cluster_addr":"172.21.15.117:6801/27953","heartbeat_back_addr":"172.21.15.117:6803/27953","heartbeat_front_addr":"172.21.15.117:6802/27953","state":["exists","up"]},{"osd":3,"uuid":"ddca42d1-70ca-415f-bde3-1e3169f8ce81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6812","nonce":27952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6813","nonce":27952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6815","nonce":27952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6814","nonce":27952}]},"public_addr":"172.21.15.117:6812/27952","cluster_addr":"172.21.15.117:6813/27952","heartbeat_back_addr":"172.21.15.117:6815/27952","heartbeat_front_addr":"172.21.15.117:6814/27952","state":["exists","up"]},{"osd":4,"uuid":"82366822-5d13-4c35-97ae-065f115f107b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6804","nonce":28013}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6805","nonce":28013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6807","nonce":28013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6806","nonce":28013}]},"public_addr":"172.21.15.148:6804/28013","cluster_addr":"172.21.15.148:6805/28013","heartbeat_back_addr":"172.21.15.148:6807/28013","heartbeat_front_addr":"172.21.15.148:6806/28013","state":["exists","up"]},{"osd":5,"uuid":"e09c9352-5d33-4e18-978e-4af5b0ff771e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6811","nonce":28011}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6813","nonce":28011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6815","nonce":28011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6814","nonce":28011}]},"public_addr":"172.21.15.148:6811/28011","cluster_addr":"172.21.15.148:6813/28011","heartbeat_back_addr":"172.21.15.148:6815/28011","heartbeat_front_addr":"172.21.15.148:6814/28011","state":["exists","up"]},{"osd":6,"uuid":"3331e9a0-bf3a-4eff-b876-56b4bb973349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6808","nonce":28014}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6809","nonce":28014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6812","nonce":28014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6810","nonce":28014}]},"public_addr":"172.21.15.148:6808/28014","cluster_addr":"172.21.15.148:6809/28014","heartbeat_back_addr":"172.21.15.148:6812/28014","heartbeat_front_addr":"172.21.15.148:6810/28014","state":["exists","up"]},{"osd":7,"uuid":"d77ce8ca-2885-4567-b2e1-2d74433e3bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6800","nonce":28012}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6801","nonce":28012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6803","nonce":28012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6802","nonce":28012}]},"public_addr":"172.21.15.148:6800/28012","cluster_addr":"172.21.15.148:6801/28012","heartbeat_back_addr":"172.21.15.148:6803/28012","heartbeat_front_addr":"172.21.15.148:6802/28012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.523796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.889540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.786488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:08.071101+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:08.046491+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.799254+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.825528+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.335598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T12:23:10.914 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-25T12:23:10.914 INFO:tasks.ceph:Creating RBD pool 2023-01-25T12:23:10.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-25T12:23:11.287 INFO:tasks.ceph.osd.3.smithi117.stderr:2023-01-25T12:23:11.278+0000 7feeeb653700 -1 osd.3 13 handle_osd_map injecting map crc failure 2023-01-25T12:23:11.299 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'rbd' created 2023-01-25T12:23:11.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-25T12:23:11.553 INFO:tasks.ceph.osd.2.smithi117.stderr:2023-01-25T12:23:11.546+0000 7faa014d5700 -1 osd.2 14 handle_osd_map injecting map crc failure 2023-01-25T12:23:12.300 INFO:teuthology.orchestra.run.smithi117.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-25T12:23:12.313 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-25T12:23:12.314 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-25T12:23:12.314 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-25T12:23:12.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-25T12:23:12.315 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-25T12:23:12.729 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:12.749 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":5,"active_gid":4109,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6816","nonce":27794}]},"active_addr":"172.21.15.117:6816/27794","active_change":"2023-01-25T12:23:05.480997+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1714854643}]},{"addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3767528051}]},{"addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3990751593}]},{"addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":2342404466}]}]}} 2023-01-25T12:23:12.753 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-25T12:23:12.753 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-25T12:23:12.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T12:23:13.053 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:13.054 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"fsid":"814e11f4-6e34-411d-8202-e91b5ec6cfee","created":"2023-01-25T12:23:00.478907+0000","modified":"2023-01-25T12:23:12.283971+0000","last_up_change":"2023-01-25T12:23:09.251087+0000","last_in_change":"2023-01-25T12:23:02.537193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T12:23:09.555417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-25T12:23:11.244133+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"68adfa07-6535-47c4-8201-28ea95fbc9ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6804","nonce":27954}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6805","nonce":27954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6807","nonce":27954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6806","nonce":27954}]},"public_addr":"172.21.15.117:6804/27954","cluster_addr":"172.21.15.117:6805/27954","heartbeat_back_addr":"172.21.15.117:6807/27954","heartbeat_front_addr":"172.21.15.117:6806/27954","state":["exists","up"]},{"osd":1,"uuid":"408c3819-f2b1-4e02-bca2-533176953430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6808","nonce":27955}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6809","nonce":27955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6811","nonce":27955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6810","nonce":27955}]},"public_addr":"172.21.15.117:6808/27955","cluster_addr":"172.21.15.117:6809/27955","heartbeat_back_addr":"172.21.15.117:6811/27955","heartbeat_front_addr":"172.21.15.117:6810/27955","state":["exists","up"]},{"osd":2,"uuid":"413eac7e-c4a5-4da6-9adb-45021d8a7e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6800","nonce":27953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6801","nonce":27953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6803","nonce":27953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6802","nonce":27953}]},"public_addr":"172.21.15.117:6800/27953","cluster_addr":"172.21.15.117:6801/27953","heartbeat_back_addr":"172.21.15.117:6803/27953","heartbeat_front_addr":"172.21.15.117:6802/27953","state":["exists","up"]},{"osd":3,"uuid":"ddca42d1-70ca-415f-bde3-1e3169f8ce81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6812","nonce":27952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6813","nonce":27952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6815","nonce":27952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6814","nonce":27952}]},"public_addr":"172.21.15.117:6812/27952","cluster_addr":"172.21.15.117:6813/27952","heartbeat_back_addr":"172.21.15.117:6815/27952","heartbeat_front_addr":"172.21.15.117:6814/27952","state":["exists","up"]},{"osd":4,"uuid":"82366822-5d13-4c35-97ae-065f115f107b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6804","nonce":28013}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6805","nonce":28013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6807","nonce":28013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6806","nonce":28013}]},"public_addr":"172.21.15.148:6804/28013","cluster_addr":"172.21.15.148:6805/28013","heartbeat_back_addr":"172.21.15.148:6807/28013","heartbeat_front_addr":"172.21.15.148:6806/28013","state":["exists","up"]},{"osd":5,"uuid":"e09c9352-5d33-4e18-978e-4af5b0ff771e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6811","nonce":28011}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6813","nonce":28011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6815","nonce":28011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6814","nonce":28011}]},"public_addr":"172.21.15.148:6811/28011","cluster_addr":"172.21.15.148:6813/28011","heartbeat_back_addr":"172.21.15.148:6815/28011","heartbeat_front_addr":"172.21.15.148:6814/28011","state":["exists","up"]},{"osd":6,"uuid":"3331e9a0-bf3a-4eff-b876-56b4bb973349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6808","nonce":28014}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6809","nonce":28014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6812","nonce":28014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6810","nonce":28014}]},"public_addr":"172.21.15.148:6808/28014","cluster_addr":"172.21.15.148:6809/28014","heartbeat_back_addr":"172.21.15.148:6812/28014","heartbeat_front_addr":"172.21.15.148:6810/28014","state":["exists","up"]},{"osd":7,"uuid":"d77ce8ca-2885-4567-b2e1-2d74433e3bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6800","nonce":28012}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6801","nonce":28012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6803","nonce":28012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6802","nonce":28012}]},"public_addr":"172.21.15.148:6800/28012","cluster_addr":"172.21.15.148:6801/28012","heartbeat_back_addr":"172.21.15.148:6803/28012","heartbeat_front_addr":"172.21.15.148:6802/28012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.523796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.889540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.786488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:08.071101+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:08.046491+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.799254+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.825528+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.335598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T12:23:13.068 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-25T12:23:13.068 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T12:23:13.353 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:13.353 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":17,"fsid":"814e11f4-6e34-411d-8202-e91b5ec6cfee","created":"2023-01-25T12:23:00.478907+0000","modified":"2023-01-25T12:23:13.286637+0000","last_up_change":"2023-01-25T12:23:09.251087+0000","last_in_change":"2023-01-25T12:23:02.537193+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T12:23:09.555417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-25T12:23:11.244133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"68adfa07-6535-47c4-8201-28ea95fbc9ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6804","nonce":27954}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6805","nonce":27954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6807","nonce":27954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6806","nonce":27954}]},"public_addr":"172.21.15.117:6804/27954","cluster_addr":"172.21.15.117:6805/27954","heartbeat_back_addr":"172.21.15.117:6807/27954","heartbeat_front_addr":"172.21.15.117:6806/27954","state":["exists","up"]},{"osd":1,"uuid":"408c3819-f2b1-4e02-bca2-533176953430","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6808","nonce":27955}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6809","nonce":27955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6811","nonce":27955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6810","nonce":27955}]},"public_addr":"172.21.15.117:6808/27955","cluster_addr":"172.21.15.117:6809/27955","heartbeat_back_addr":"172.21.15.117:6811/27955","heartbeat_front_addr":"172.21.15.117:6810/27955","state":["exists","up"]},{"osd":2,"uuid":"413eac7e-c4a5-4da6-9adb-45021d8a7e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6800","nonce":27953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6801","nonce":27953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6803","nonce":27953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6802","nonce":27953}]},"public_addr":"172.21.15.117:6800/27953","cluster_addr":"172.21.15.117:6801/27953","heartbeat_back_addr":"172.21.15.117:6803/27953","heartbeat_front_addr":"172.21.15.117:6802/27953","state":["exists","up"]},{"osd":3,"uuid":"ddca42d1-70ca-415f-bde3-1e3169f8ce81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6812","nonce":27952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6813","nonce":27952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6815","nonce":27952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.117:6814","nonce":27952}]},"public_addr":"172.21.15.117:6812/27952","cluster_addr":"172.21.15.117:6813/27952","heartbeat_back_addr":"172.21.15.117:6815/27952","heartbeat_front_addr":"172.21.15.117:6814/27952","state":["exists","up"]},{"osd":4,"uuid":"82366822-5d13-4c35-97ae-065f115f107b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6804","nonce":28013}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6805","nonce":28013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6807","nonce":28013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6806","nonce":28013}]},"public_addr":"172.21.15.148:6804/28013","cluster_addr":"172.21.15.148:6805/28013","heartbeat_back_addr":"172.21.15.148:6807/28013","heartbeat_front_addr":"172.21.15.148:6806/28013","state":["exists","up"]},{"osd":5,"uuid":"e09c9352-5d33-4e18-978e-4af5b0ff771e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6811","nonce":28011}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6813","nonce":28011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6815","nonce":28011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6814","nonce":28011}]},"public_addr":"172.21.15.148:6811/28011","cluster_addr":"172.21.15.148:6813/28011","heartbeat_back_addr":"172.21.15.148:6815/28011","heartbeat_front_addr":"172.21.15.148:6814/28011","state":["exists","up"]},{"osd":6,"uuid":"3331e9a0-bf3a-4eff-b876-56b4bb973349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6808","nonce":28014}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6809","nonce":28014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6812","nonce":28014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6810","nonce":28014}]},"public_addr":"172.21.15.148:6808/28014","cluster_addr":"172.21.15.148:6809/28014","heartbeat_back_addr":"172.21.15.148:6812/28014","heartbeat_front_addr":"172.21.15.148:6810/28014","state":["exists","up"]},{"osd":7,"uuid":"d77ce8ca-2885-4567-b2e1-2d74433e3bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6800","nonce":28012}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6801","nonce":28012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6803","nonce":28012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.148:6802","nonce":28012}]},"public_addr":"172.21.15.148:6800/28012","cluster_addr":"172.21.15.148:6801/28012","heartbeat_back_addr":"172.21.15.148:6803/28012","heartbeat_front_addr":"172.21.15.148:6802/28012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.523796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.889540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.786488+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:08.071101+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:08.046491+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.799254+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.825528+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T12:23:07.335598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T12:23:13.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-25T12:23:13.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-25T12:23:13.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-25T12:23:13.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-25T12:23:13.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-25T12:23:13.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-25T12:23:13.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-25T12:23:13.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-25T12:23:13.576 INFO:teuthology.orchestra.run.smithi117.stdout:55834574851 2023-01-25T12:23:13.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T12:23:13.582 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:13.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T12:23:13.586 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:13.586 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T12:23:13.589 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:13.590 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T12:23:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:55834574851 2023-01-25T12:23:13.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T12:23:13.601 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:13.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T12:23:13.603 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:13.604 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T12:23:13.611 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:13.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T12:23:14.019 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:14.042 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:14.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.3 2023-01-25T12:23:14.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.4 2023-01-25T12:23:14.062 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:14.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2023-01-25T12:23:14.083 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:14.086 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:14.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.1 2023-01-25T12:23:14.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.6 2023-01-25T12:23:14.105 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:14.109 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:14.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.5 2023-01-25T12:23:14.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.7 2023-01-25T12:23:14.127 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:14.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.2 2023-01-25T12:23:15.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T12:23:15.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T12:23:15.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T12:23:15.102 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T12:23:15.102 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T12:23:15.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T12:23:15.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T12:23:15.141 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T12:23:15.482 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:15.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.3 2023-01-25T12:23:15.535 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:15.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.1 2023-01-25T12:23:15.551 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:15.561 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:15.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2023-01-25T12:23:15.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.4 2023-01-25T12:23:15.581 INFO:teuthology.orchestra.run.smithi117.stdout:55834574850 2023-01-25T12:23:15.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.6 2023-01-25T12:23:15.608 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:15.619 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:15.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.5 2023-01-25T12:23:15.624 INFO:teuthology.orchestra.run.smithi117.stdout:55834574849 2023-01-25T12:23:15.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.2 2023-01-25T12:23:15.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.7 2023-01-25T12:23:16.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T12:23:16.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T12:23:16.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T12:23:16.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T12:23:16.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T12:23:16.621 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T12:23:16.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T12:23:16.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T12:23:16.934 INFO:teuthology.orchestra.run.smithi117.stdout:55834574851 2023-01-25T12:23:16.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574851 for osd.3 2023-01-25T12:23:16.955 DEBUG:teuthology.parallel:result is None 2023-01-25T12:23:16.979 INFO:teuthology.orchestra.run.smithi117.stdout:55834574851 2023-01-25T12:23:16.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574851 for osd.1 2023-01-25T12:23:16.996 DEBUG:teuthology.parallel:result is None 2023-01-25T12:23:17.012 INFO:teuthology.orchestra.run.smithi117.stdout:55834574852 2023-01-25T12:23:17.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.0 2023-01-25T12:23:17.025 DEBUG:teuthology.parallel:result is None 2023-01-25T12:23:17.043 INFO:teuthology.orchestra.run.smithi117.stdout:55834574851 2023-01-25T12:23:17.044 INFO:teuthology.orchestra.run.smithi117.stdout:55834574851 2023-01-25T12:23:17.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574851 for osd.5 2023-01-25T12:23:17.058 DEBUG:teuthology.parallel:result is None 2023-01-25T12:23:17.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574851 for osd.4 2023-01-25T12:23:17.060 DEBUG:teuthology.parallel:result is None 2023-01-25T12:23:17.066 INFO:teuthology.orchestra.run.smithi117.stdout:55834574852 2023-01-25T12:23:17.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.6 2023-01-25T12:23:17.083 DEBUG:teuthology.parallel:result is None 2023-01-25T12:23:17.100 INFO:teuthology.orchestra.run.smithi117.stdout:55834574851 2023-01-25T12:23:17.108 INFO:teuthology.orchestra.run.smithi117.stdout:55834574851 2023-01-25T12:23:17.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574851 for osd.2 2023-01-25T12:23:17.113 DEBUG:teuthology.parallel:result is None 2023-01-25T12:23:17.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574851 for osd.7 2023-01-25T12:23:17.124 DEBUG:teuthology.parallel:result is None 2023-01-25T12:23:17.124 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T12:23:17.124 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T12:23:17.445 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:17.448 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-01-25T12:23:17.458 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-01-25T12:23:15.493047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":41348,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":40192,"kb_avail":754933372,"statfs":{"total":773094113280,"available":773051772928,"internally_reserved":0,"allocated":1060864,"data_stored":1397293,"data_compressed":10616,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":41156608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.575812+0000","last_change":"2023-01-25T12:23:12.302798+0000","last_active":"2023-01-25T12:23:13.575812+0000","last_peered":"2023-01-25T12:23:13.575812+0000","last_clean":"2023-01-25T12:23:13.575812+0000","last_became_active":"2023-01-25T12:23:12.302513+0000","last_became_peered":"2023-01-25T12:23:12.302513+0000","last_unstale":"2023-01-25T12:23:13.575812+0000","last_undegraded":"2023-01-25T12:23:13.575812+0000","last_fullsized":"2023-01-25T12:23:13.575812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:18.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.293624+0000","last_change":"2023-01-25T12:23:12.302286+0000","last_active":"2023-01-25T12:23:13.293624+0000","last_peered":"2023-01-25T12:23:13.293624+0000","last_clean":"2023-01-25T12:23:13.293624+0000","last_became_active":"2023-01-25T12:23:12.301959+0000","last_became_peered":"2023-01-25T12:23:12.301959+0000","last_unstale":"2023-01-25T12:23:13.293624+0000","last_undegraded":"2023-01-25T12:23:13.293624+0000","last_fullsized":"2023-01-25T12:23:13.293624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:28.358329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587720+0000","last_change":"2023-01-25T12:23:12.438573+0000","last_active":"2023-01-25T12:23:13.587720+0000","last_peered":"2023-01-25T12:23:13.587720+0000","last_clean":"2023-01-25T12:23:13.587720+0000","last_became_active":"2023-01-25T12:23:12.437926+0000","last_became_peered":"2023-01-25T12:23:12.437926+0000","last_unstale":"2023-01-25T12:23:13.587720+0000","last_undegraded":"2023-01-25T12:23:13.587720+0000","last_fullsized":"2023-01-25T12:23:13.587720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:31.625313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.293640+0000","last_change":"2023-01-25T12:23:12.437650+0000","last_active":"2023-01-25T12:23:13.293640+0000","last_peered":"2023-01-25T12:23:13.293640+0000","last_clean":"2023-01-25T12:23:13.293640+0000","last_became_active":"2023-01-25T12:23:12.437241+0000","last_became_peered":"2023-01-25T12:23:12.437241+0000","last_unstale":"2023-01-25T12:23:13.293640+0000","last_undegraded":"2023-01-25T12:23:13.293640+0000","last_fullsized":"2023-01-25T12:23:13.293640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:31.373862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.578309+0000","last_change":"2023-01-25T12:23:12.299763+0000","last_active":"2023-01-25T12:23:13.578309+0000","last_peered":"2023-01-25T12:23:13.578309+0000","last_clean":"2023-01-25T12:23:13.578309+0000","last_became_active":"2023-01-25T12:23:12.299320+0000","last_became_peered":"2023-01-25T12:23:12.299320+0000","last_unstale":"2023-01-25T12:23:13.578309+0000","last_undegraded":"2023-01-25T12:23:13.578309+0000","last_fullsized":"2023-01-25T12:23:13.578309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:29.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.577230+0000","last_change":"2023-01-25T12:23:12.303755+0000","last_active":"2023-01-25T12:23:13.577230+0000","last_peered":"2023-01-25T12:23:13.577230+0000","last_clean":"2023-01-25T12:23:13.577230+0000","last_became_active":"2023-01-25T12:23:12.303278+0000","last_became_peered":"2023-01-25T12:23:12.303278+0000","last_unstale":"2023-01-25T12:23:13.577230+0000","last_undegraded":"2023-01-25T12:23:13.577230+0000","last_fullsized":"2023-01-25T12:23:13.577230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:14.319994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587603+0000","last_change":"2023-01-25T12:23:12.301711+0000","last_active":"2023-01-25T12:23:13.587603+0000","last_peered":"2023-01-25T12:23:13.587603+0000","last_clean":"2023-01-25T12:23:13.587603+0000","last_became_active":"2023-01-25T12:23:12.301366+0000","last_became_peered":"2023-01-25T12:23:12.301366+0000","last_unstale":"2023-01-25T12:23:13.587603+0000","last_undegraded":"2023-01-25T12:23:13.587603+0000","last_fullsized":"2023-01-25T12:23:13.587603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:27.251220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.578344+0000","last_change":"2023-01-25T12:23:12.304704+0000","last_active":"2023-01-25T12:23:13.578344+0000","last_peered":"2023-01-25T12:23:13.578344+0000","last_clean":"2023-01-25T12:23:13.578344+0000","last_became_active":"2023-01-25T12:23:12.304194+0000","last_became_peered":"2023-01-25T12:23:12.304194+0000","last_unstale":"2023-01-25T12:23:13.578344+0000","last_undegraded":"2023-01-25T12:23:13.578344+0000","last_fullsized":"2023-01-25T12:23:13.578344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:22.127541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587659+0000","last_change":"2023-01-25T12:23:11.297157+0000","last_active":"2023-01-25T12:23:13.587659+0000","last_peered":"2023-01-25T12:23:13.587659+0000","last_clean":"2023-01-25T12:23:13.587659+0000","last_became_active":"2023-01-25T12:23:11.296506+0000","last_became_peered":"2023-01-25T12:23:11.296506+0000","last_unstale":"2023-01-25T12:23:13.587659+0000","last_undegraded":"2023-01-25T12:23:13.587659+0000","last_fullsized":"2023-01-25T12:23:13.587659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:10.267067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:10.267067+0000","last_clean_scrub_stamp":"2023-01-25T12:23:10.267067+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:19.821524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":10616,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5584,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366256,"statfs":{"total":96636764160,"available":96631046144,"internally_reserved":0,"allocated":176128,"data_stored":571243,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5016,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366824,"statfs":{"total":96636764160,"available":96631627776,"internally_reserved":0,"allocated":147456,"data_stored":46190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5060,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366780,"statfs":{"total":96636764160,"available":96631582720,"internally_reserved":0,"allocated":126976,"data_stored":43334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.889}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5052,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366788,"statfs":{"total":96636764160,"available":96631590912,"internally_reserved":0,"allocated":118784,"data_stored":42774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4960,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366880,"statfs":{"total":96636764160,"available":96631685120,"internally_reserved":0,"allocated":90112,"data_stored":38430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5060,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366780,"statfs":{"total":96636764160,"available":96631582720,"internally_reserved":0,"allocated":126976,"data_stored":42650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5040,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366800,"statfs":{"total":96636764160,"available":96631603200,"internally_reserved":0,"allocated":106496,"data_stored":41934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5576,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366264,"statfs":{"total":96636764160,"available":96631054336,"internally_reserved":0,"allocated":167936,"data_stored":570738,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T12:23:17.460 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T12:23:17.728 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:17.730 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-01-25T12:23:17.741 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-01-25T12:23:17.493467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":41348,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":40192,"kb_avail":754933372,"statfs":{"total":773094113280,"available":773051772928,"internally_reserved":0,"allocated":1060864,"data_stored":1397293,"data_compressed":10616,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":41156608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000420"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.575812+0000","last_change":"2023-01-25T12:23:12.302798+0000","last_active":"2023-01-25T12:23:13.575812+0000","last_peered":"2023-01-25T12:23:13.575812+0000","last_clean":"2023-01-25T12:23:13.575812+0000","last_became_active":"2023-01-25T12:23:12.302513+0000","last_became_peered":"2023-01-25T12:23:12.302513+0000","last_unstale":"2023-01-25T12:23:13.575812+0000","last_undegraded":"2023-01-25T12:23:13.575812+0000","last_fullsized":"2023-01-25T12:23:13.575812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:18.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.293624+0000","last_change":"2023-01-25T12:23:12.302286+0000","last_active":"2023-01-25T12:23:13.293624+0000","last_peered":"2023-01-25T12:23:13.293624+0000","last_clean":"2023-01-25T12:23:13.293624+0000","last_became_active":"2023-01-25T12:23:12.301959+0000","last_became_peered":"2023-01-25T12:23:12.301959+0000","last_unstale":"2023-01-25T12:23:13.293624+0000","last_undegraded":"2023-01-25T12:23:13.293624+0000","last_fullsized":"2023-01-25T12:23:13.293624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:28.358329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587720+0000","last_change":"2023-01-25T12:23:12.438573+0000","last_active":"2023-01-25T12:23:13.587720+0000","last_peered":"2023-01-25T12:23:13.587720+0000","last_clean":"2023-01-25T12:23:13.587720+0000","last_became_active":"2023-01-25T12:23:12.437926+0000","last_became_peered":"2023-01-25T12:23:12.437926+0000","last_unstale":"2023-01-25T12:23:13.587720+0000","last_undegraded":"2023-01-25T12:23:13.587720+0000","last_fullsized":"2023-01-25T12:23:13.587720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:31.625313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.293640+0000","last_change":"2023-01-25T12:23:12.437650+0000","last_active":"2023-01-25T12:23:13.293640+0000","last_peered":"2023-01-25T12:23:13.293640+0000","last_clean":"2023-01-25T12:23:13.293640+0000","last_became_active":"2023-01-25T12:23:12.437241+0000","last_became_peered":"2023-01-25T12:23:12.437241+0000","last_unstale":"2023-01-25T12:23:13.293640+0000","last_undegraded":"2023-01-25T12:23:13.293640+0000","last_fullsized":"2023-01-25T12:23:13.293640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:31.373862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.578309+0000","last_change":"2023-01-25T12:23:12.299763+0000","last_active":"2023-01-25T12:23:13.578309+0000","last_peered":"2023-01-25T12:23:13.578309+0000","last_clean":"2023-01-25T12:23:13.578309+0000","last_became_active":"2023-01-25T12:23:12.299320+0000","last_became_peered":"2023-01-25T12:23:12.299320+0000","last_unstale":"2023-01-25T12:23:13.578309+0000","last_undegraded":"2023-01-25T12:23:13.578309+0000","last_fullsized":"2023-01-25T12:23:13.578309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:29.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.577230+0000","last_change":"2023-01-25T12:23:12.303755+0000","last_active":"2023-01-25T12:23:13.577230+0000","last_peered":"2023-01-25T12:23:13.577230+0000","last_clean":"2023-01-25T12:23:13.577230+0000","last_became_active":"2023-01-25T12:23:12.303278+0000","last_became_peered":"2023-01-25T12:23:12.303278+0000","last_unstale":"2023-01-25T12:23:13.577230+0000","last_undegraded":"2023-01-25T12:23:13.577230+0000","last_fullsized":"2023-01-25T12:23:13.577230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:14.319994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587603+0000","last_change":"2023-01-25T12:23:12.301711+0000","last_active":"2023-01-25T12:23:13.587603+0000","last_peered":"2023-01-25T12:23:13.587603+0000","last_clean":"2023-01-25T12:23:13.587603+0000","last_became_active":"2023-01-25T12:23:12.301366+0000","last_became_peered":"2023-01-25T12:23:12.301366+0000","last_unstale":"2023-01-25T12:23:13.587603+0000","last_undegraded":"2023-01-25T12:23:13.587603+0000","last_fullsized":"2023-01-25T12:23:13.587603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:27.251220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.578344+0000","last_change":"2023-01-25T12:23:12.304704+0000","last_active":"2023-01-25T12:23:13.578344+0000","last_peered":"2023-01-25T12:23:13.578344+0000","last_clean":"2023-01-25T12:23:13.578344+0000","last_became_active":"2023-01-25T12:23:12.304194+0000","last_became_peered":"2023-01-25T12:23:12.304194+0000","last_unstale":"2023-01-25T12:23:13.578344+0000","last_undegraded":"2023-01-25T12:23:13.578344+0000","last_fullsized":"2023-01-25T12:23:13.578344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:22.127541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587659+0000","last_change":"2023-01-25T12:23:11.297157+0000","last_active":"2023-01-25T12:23:13.587659+0000","last_peered":"2023-01-25T12:23:13.587659+0000","last_clean":"2023-01-25T12:23:13.587659+0000","last_became_active":"2023-01-25T12:23:11.296506+0000","last_became_peered":"2023-01-25T12:23:11.296506+0000","last_unstale":"2023-01-25T12:23:13.587659+0000","last_undegraded":"2023-01-25T12:23:13.587659+0000","last_fullsized":"2023-01-25T12:23:13.587659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:10.267067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:10.267067+0000","last_clean_scrub_stamp":"2023-01-25T12:23:10.267067+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:19.821524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":10616,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5584,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366256,"statfs":{"total":96636764160,"available":96631046144,"internally_reserved":0,"allocated":176128,"data_stored":571243,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5016,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366824,"statfs":{"total":96636764160,"available":96631627776,"internally_reserved":0,"allocated":147456,"data_stored":46190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5060,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366780,"statfs":{"total":96636764160,"available":96631582720,"internally_reserved":0,"allocated":126976,"data_stored":43334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.889}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5052,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366788,"statfs":{"total":96636764160,"available":96631590912,"internally_reserved":0,"allocated":118784,"data_stored":42774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4960,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366880,"statfs":{"total":96636764160,"available":96631685120,"internally_reserved":0,"allocated":90112,"data_stored":38430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5060,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366780,"statfs":{"total":96636764160,"available":96631582720,"internally_reserved":0,"allocated":126976,"data_stored":42650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5040,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366800,"statfs":{"total":96636764160,"available":96631603200,"internally_reserved":0,"allocated":106496,"data_stored":41934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5576,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366264,"statfs":{"total":96636764160,"available":96631054336,"internally_reserved":0,"allocated":167936,"data_stored":570738,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T12:23:17.743 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T12:23:17.743 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-25T12:23:17.743 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-25T12:23:17.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-25T12:23:18.049 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:18.049 INFO:teuthology.orchestra.run.smithi117.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-25T12:23:18.069 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-25T12:23:18.070 INFO:teuthology.run_tasks:Running task exec... 2023-01-25T12:23:18.079 INFO:teuthology.task.exec:Executing custom commands... 2023-01-25T12:23:18.079 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi117.front.sepia.ceph.com 2023-01-25T12:23:18.080 DEBUG:teuthology.orchestra.run.smithi117:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! ceph balancer status ; do sleep 1 ; done' 2023-01-25T12:23:18.358 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-01-25T12:23:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "active": true, 2023-01-25T12:23:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "last_optimize_duration": "0:00:00.000462", 2023-01-25T12:23:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "last_optimize_started": "Wed Jan 25 12:23:05 2023", 2023-01-25T12:23:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "mode": "upmap", 2023-01-25T12:23:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "no_optimization_needed": false, 2023-01-25T12:23:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: "optimize_result": "No pools available", 2023-01-25T12:23:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: "plans": [] 2023-01-25T12:23:18.360 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-01-25T12:23:18.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode crush-compat' 2023-01-25T12:23:19.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2023-01-25T12:23:19.614 INFO:teuthology.run_tasks:Running task thrashosds... 2023-01-25T12:23:19.625 INFO:tasks.thrashosds:config is {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-25T12:23:19.625 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri6-testing-2023-01-24-0746'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_async_recovery_min_cost': 1, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'mon_bind_msgr2': False, 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2023-01-24-0746', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}} 2023-01-25T12:23:19.626 INFO:tasks.thrashosds:config is {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-01-25T12:23:19.626 INFO:tasks.thrashosds:Beginning thrashosds... 2023-01-25T12:23:19.626 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T12:23:19.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T12:23:19.910 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:19.913 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-01-25T12:23:19.924 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T12:23:19.493912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":41348,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":40192,"kb_avail":754933372,"statfs":{"total":773094113280,"available":773051772928,"internally_reserved":0,"allocated":1060864,"data_stored":1397293,"data_compressed":10616,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":41156608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000864"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.575812+0000","last_change":"2023-01-25T12:23:12.302798+0000","last_active":"2023-01-25T12:23:13.575812+0000","last_peered":"2023-01-25T12:23:13.575812+0000","last_clean":"2023-01-25T12:23:13.575812+0000","last_became_active":"2023-01-25T12:23:12.302513+0000","last_became_peered":"2023-01-25T12:23:12.302513+0000","last_unstale":"2023-01-25T12:23:13.575812+0000","last_undegraded":"2023-01-25T12:23:13.575812+0000","last_fullsized":"2023-01-25T12:23:13.575812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:18.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.293624+0000","last_change":"2023-01-25T12:23:12.302286+0000","last_active":"2023-01-25T12:23:13.293624+0000","last_peered":"2023-01-25T12:23:13.293624+0000","last_clean":"2023-01-25T12:23:13.293624+0000","last_became_active":"2023-01-25T12:23:12.301959+0000","last_became_peered":"2023-01-25T12:23:12.301959+0000","last_unstale":"2023-01-25T12:23:13.293624+0000","last_undegraded":"2023-01-25T12:23:13.293624+0000","last_fullsized":"2023-01-25T12:23:13.293624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:28.358329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587720+0000","last_change":"2023-01-25T12:23:12.438573+0000","last_active":"2023-01-25T12:23:13.587720+0000","last_peered":"2023-01-25T12:23:13.587720+0000","last_clean":"2023-01-25T12:23:13.587720+0000","last_became_active":"2023-01-25T12:23:12.437926+0000","last_became_peered":"2023-01-25T12:23:12.437926+0000","last_unstale":"2023-01-25T12:23:13.587720+0000","last_undegraded":"2023-01-25T12:23:13.587720+0000","last_fullsized":"2023-01-25T12:23:13.587720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:31.625313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.293640+0000","last_change":"2023-01-25T12:23:12.437650+0000","last_active":"2023-01-25T12:23:13.293640+0000","last_peered":"2023-01-25T12:23:13.293640+0000","last_clean":"2023-01-25T12:23:13.293640+0000","last_became_active":"2023-01-25T12:23:12.437241+0000","last_became_peered":"2023-01-25T12:23:12.437241+0000","last_unstale":"2023-01-25T12:23:13.293640+0000","last_undegraded":"2023-01-25T12:23:13.293640+0000","last_fullsized":"2023-01-25T12:23:13.293640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:31.373862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.578309+0000","last_change":"2023-01-25T12:23:12.299763+0000","last_active":"2023-01-25T12:23:13.578309+0000","last_peered":"2023-01-25T12:23:13.578309+0000","last_clean":"2023-01-25T12:23:13.578309+0000","last_became_active":"2023-01-25T12:23:12.299320+0000","last_became_peered":"2023-01-25T12:23:12.299320+0000","last_unstale":"2023-01-25T12:23:13.578309+0000","last_undegraded":"2023-01-25T12:23:13.578309+0000","last_fullsized":"2023-01-25T12:23:13.578309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:29.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.577230+0000","last_change":"2023-01-25T12:23:12.303755+0000","last_active":"2023-01-25T12:23:13.577230+0000","last_peered":"2023-01-25T12:23:13.577230+0000","last_clean":"2023-01-25T12:23:13.577230+0000","last_became_active":"2023-01-25T12:23:12.303278+0000","last_became_peered":"2023-01-25T12:23:12.303278+0000","last_unstale":"2023-01-25T12:23:13.577230+0000","last_undegraded":"2023-01-25T12:23:13.577230+0000","last_fullsized":"2023-01-25T12:23:13.577230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:14.319994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587603+0000","last_change":"2023-01-25T12:23:12.301711+0000","last_active":"2023-01-25T12:23:13.587603+0000","last_peered":"2023-01-25T12:23:13.587603+0000","last_clean":"2023-01-25T12:23:13.587603+0000","last_became_active":"2023-01-25T12:23:12.301366+0000","last_became_peered":"2023-01-25T12:23:12.301366+0000","last_unstale":"2023-01-25T12:23:13.587603+0000","last_undegraded":"2023-01-25T12:23:13.587603+0000","last_fullsized":"2023-01-25T12:23:13.587603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:27.251220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.578344+0000","last_change":"2023-01-25T12:23:12.304704+0000","last_active":"2023-01-25T12:23:13.578344+0000","last_peered":"2023-01-25T12:23:13.578344+0000","last_clean":"2023-01-25T12:23:13.578344+0000","last_became_active":"2023-01-25T12:23:12.304194+0000","last_became_peered":"2023-01-25T12:23:12.304194+0000","last_unstale":"2023-01-25T12:23:13.578344+0000","last_undegraded":"2023-01-25T12:23:13.578344+0000","last_fullsized":"2023-01-25T12:23:13.578344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:22.127541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587659+0000","last_change":"2023-01-25T12:23:11.297157+0000","last_active":"2023-01-25T12:23:13.587659+0000","last_peered":"2023-01-25T12:23:13.587659+0000","last_clean":"2023-01-25T12:23:13.587659+0000","last_became_active":"2023-01-25T12:23:11.296506+0000","last_became_peered":"2023-01-25T12:23:11.296506+0000","last_unstale":"2023-01-25T12:23:13.587659+0000","last_undegraded":"2023-01-25T12:23:13.587659+0000","last_fullsized":"2023-01-25T12:23:13.587659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:10.267067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:10.267067+0000","last_clean_scrub_stamp":"2023-01-25T12:23:10.267067+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:19.821524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":10616,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5584,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366256,"statfs":{"total":96636764160,"available":96631046144,"internally_reserved":0,"allocated":176128,"data_stored":571243,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5016,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366824,"statfs":{"total":96636764160,"available":96631627776,"internally_reserved":0,"allocated":147456,"data_stored":46190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5060,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366780,"statfs":{"total":96636764160,"available":96631582720,"internally_reserved":0,"allocated":126976,"data_stored":43334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.889}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5052,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366788,"statfs":{"total":96636764160,"available":96631590912,"internally_reserved":0,"allocated":118784,"data_stored":42774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4960,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366880,"statfs":{"total":96636764160,"available":96631685120,"internally_reserved":0,"allocated":90112,"data_stored":38430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5060,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366780,"statfs":{"total":96636764160,"available":96631582720,"internally_reserved":0,"allocated":126976,"data_stored":42650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5040,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366800,"statfs":{"total":96636764160,"available":96631603200,"internally_reserved":0,"allocated":106496,"data_stored":41934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5576,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366264,"statfs":{"total":96636764160,"available":96631054336,"internally_reserved":0,"allocated":167936,"data_stored":570738,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T12:23:19.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T12:23:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-01-25T12:23:20.218 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2023-01-25T12:23:20.229 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T12:23:19.493912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":41348,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":40192,"kb_avail":754933372,"statfs":{"total":773094113280,"available":773051772928,"internally_reserved":0,"allocated":1060864,"data_stored":1397293,"data_compressed":10616,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":41156608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000864"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.575812+0000","last_change":"2023-01-25T12:23:12.302798+0000","last_active":"2023-01-25T12:23:13.575812+0000","last_peered":"2023-01-25T12:23:13.575812+0000","last_clean":"2023-01-25T12:23:13.575812+0000","last_became_active":"2023-01-25T12:23:12.302513+0000","last_became_peered":"2023-01-25T12:23:12.302513+0000","last_unstale":"2023-01-25T12:23:13.575812+0000","last_undegraded":"2023-01-25T12:23:13.575812+0000","last_fullsized":"2023-01-25T12:23:13.575812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:18.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.293624+0000","last_change":"2023-01-25T12:23:12.302286+0000","last_active":"2023-01-25T12:23:13.293624+0000","last_peered":"2023-01-25T12:23:13.293624+0000","last_clean":"2023-01-25T12:23:13.293624+0000","last_became_active":"2023-01-25T12:23:12.301959+0000","last_became_peered":"2023-01-25T12:23:12.301959+0000","last_unstale":"2023-01-25T12:23:13.293624+0000","last_undegraded":"2023-01-25T12:23:13.293624+0000","last_fullsized":"2023-01-25T12:23:13.293624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:28.358329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587720+0000","last_change":"2023-01-25T12:23:12.438573+0000","last_active":"2023-01-25T12:23:13.587720+0000","last_peered":"2023-01-25T12:23:13.587720+0000","last_clean":"2023-01-25T12:23:13.587720+0000","last_became_active":"2023-01-25T12:23:12.437926+0000","last_became_peered":"2023-01-25T12:23:12.437926+0000","last_unstale":"2023-01-25T12:23:13.587720+0000","last_undegraded":"2023-01-25T12:23:13.587720+0000","last_fullsized":"2023-01-25T12:23:13.587720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:31.625313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.293640+0000","last_change":"2023-01-25T12:23:12.437650+0000","last_active":"2023-01-25T12:23:13.293640+0000","last_peered":"2023-01-25T12:23:13.293640+0000","last_clean":"2023-01-25T12:23:13.293640+0000","last_became_active":"2023-01-25T12:23:12.437241+0000","last_became_peered":"2023-01-25T12:23:12.437241+0000","last_unstale":"2023-01-25T12:23:13.293640+0000","last_undegraded":"2023-01-25T12:23:13.293640+0000","last_fullsized":"2023-01-25T12:23:13.293640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:31.373862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.578309+0000","last_change":"2023-01-25T12:23:12.299763+0000","last_active":"2023-01-25T12:23:13.578309+0000","last_peered":"2023-01-25T12:23:13.578309+0000","last_clean":"2023-01-25T12:23:13.578309+0000","last_became_active":"2023-01-25T12:23:12.299320+0000","last_became_peered":"2023-01-25T12:23:12.299320+0000","last_unstale":"2023-01-25T12:23:13.578309+0000","last_undegraded":"2023-01-25T12:23:13.578309+0000","last_fullsized":"2023-01-25T12:23:13.578309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:29.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.577230+0000","last_change":"2023-01-25T12:23:12.303755+0000","last_active":"2023-01-25T12:23:13.577230+0000","last_peered":"2023-01-25T12:23:13.577230+0000","last_clean":"2023-01-25T12:23:13.577230+0000","last_became_active":"2023-01-25T12:23:12.303278+0000","last_became_peered":"2023-01-25T12:23:12.303278+0000","last_unstale":"2023-01-25T12:23:13.577230+0000","last_undegraded":"2023-01-25T12:23:13.577230+0000","last_fullsized":"2023-01-25T12:23:13.577230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:14.319994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587603+0000","last_change":"2023-01-25T12:23:12.301711+0000","last_active":"2023-01-25T12:23:13.587603+0000","last_peered":"2023-01-25T12:23:13.587603+0000","last_clean":"2023-01-25T12:23:13.587603+0000","last_became_active":"2023-01-25T12:23:12.301366+0000","last_became_peered":"2023-01-25T12:23:12.301366+0000","last_unstale":"2023-01-25T12:23:13.587603+0000","last_undegraded":"2023-01-25T12:23:13.587603+0000","last_fullsized":"2023-01-25T12:23:13.587603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:27.251220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.578344+0000","last_change":"2023-01-25T12:23:12.304704+0000","last_active":"2023-01-25T12:23:13.578344+0000","last_peered":"2023-01-25T12:23:13.578344+0000","last_clean":"2023-01-25T12:23:13.578344+0000","last_became_active":"2023-01-25T12:23:12.304194+0000","last_became_peered":"2023-01-25T12:23:12.304194+0000","last_unstale":"2023-01-25T12:23:13.578344+0000","last_undegraded":"2023-01-25T12:23:13.578344+0000","last_fullsized":"2023-01-25T12:23:13.578344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:11.281041+0000","last_clean_scrub_stamp":"2023-01-25T12:23:11.281041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:22.127541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T12:23:13.587659+0000","last_change":"2023-01-25T12:23:11.297157+0000","last_active":"2023-01-25T12:23:13.587659+0000","last_peered":"2023-01-25T12:23:13.587659+0000","last_clean":"2023-01-25T12:23:13.587659+0000","last_became_active":"2023-01-25T12:23:11.296506+0000","last_became_peered":"2023-01-25T12:23:11.296506+0000","last_unstale":"2023-01-25T12:23:13.587659+0000","last_undegraded":"2023-01-25T12:23:13.587659+0000","last_fullsized":"2023-01-25T12:23:13.587659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T12:23:10.267067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T12:23:10.267067+0000","last_clean_scrub_stamp":"2023-01-25T12:23:10.267067+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T12:24:19.821524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":10616,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5584,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366256,"statfs":{"total":96636764160,"available":96631046144,"internally_reserved":0,"allocated":176128,"data_stored":571243,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5016,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366824,"statfs":{"total":96636764160,"available":96631627776,"internally_reserved":0,"allocated":147456,"data_stored":46190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5060,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366780,"statfs":{"total":96636764160,"available":96631582720,"internally_reserved":0,"allocated":126976,"data_stored":43334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.889}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5052,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366788,"statfs":{"total":96636764160,"available":96631590912,"internally_reserved":0,"allocated":118784,"data_stored":42774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4960,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366880,"statfs":{"total":96636764160,"available":96631685120,"internally_reserved":0,"allocated":90112,"data_stored":38430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5060,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366780,"statfs":{"total":96636764160,"available":96631582720,"internally_reserved":0,"allocated":126976,"data_stored":42650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5040,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366800,"statfs":{"total":96636764160,"available":96631603200,"internally_reserved":0,"allocated":106496,"data_stored":41934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5576,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94366264,"statfs":{"total":96636764160,"available":96631054336,"internally_reserved":0,"allocated":167936,"data_stored":570738,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5308,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T12:23:20.231 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T12:23:20.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-01-25T12:23:20.522 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 18 2023-01-25T12:23:20.522 INFO:teuthology.orchestra.run.smithi117.stdout:fsid 814e11f4-6e34-411d-8202-e91b5ec6cfee 2023-01-25T12:23:20.522 INFO:teuthology.orchestra.run.smithi117.stdout:created 2023-01-25T12:23:00.478907+0000 2023-01-25T12:23:20.522 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2023-01-25T12:23:19.247123+0000 2023-01-25T12:23:20.523 INFO:teuthology.orchestra.run.smithi117.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-25T12:23:20.523 INFO:teuthology.orchestra.run.smithi117.stdout:crush_version 5 2023-01-25T12:23:20.523 INFO:teuthology.orchestra.run.smithi117.stdout:full_ratio 0.95 2023-01-25T12:23:20.523 INFO:teuthology.orchestra.run.smithi117.stdout:backfillfull_ratio 0.9 2023-01-25T12:23:20.523 INFO:teuthology.orchestra.run.smithi117.stdout:nearfull_ratio 0.85 2023-01-25T12:23:20.524 INFO:teuthology.orchestra.run.smithi117.stdout:require_min_compat_client luminous 2023-01-25T12:23:20.524 INFO:teuthology.orchestra.run.smithi117.stdout:min_compat_client jewel 2023-01-25T12:23:20.524 INFO:teuthology.orchestra.run.smithi117.stdout:require_osd_release reef 2023-01-25T12:23:20.524 INFO:teuthology.orchestra.run.smithi117.stdout:stretch_mode_enabled false 2023-01-25T12:23:20.524 INFO:teuthology.orchestra.run.smithi117.stdout:pool 1 '.mgr' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-01-25T12:23:20.525 INFO:teuthology.orchestra.run.smithi117.stdout:pool 2 'rbd' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 application rbd 2023-01-25T12:23:20.525 INFO:teuthology.orchestra.run.smithi117.stdout:max_osd 8 2023-01-25T12:23:20.525 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6804/27954 v1:172.21.15.117:6805/27954 exists,up 68adfa07-6535-47c4-8201-28ea95fbc9ca 2023-01-25T12:23:20.525 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6808/27955 v1:172.21.15.117:6809/27955 exists,up 408c3819-f2b1-4e02-bca2-533176953430 2023-01-25T12:23:20.525 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6800/27953 v1:172.21.15.117:6801/27953 exists,up 413eac7e-c4a5-4da6-9adb-45021d8a7e34 2023-01-25T12:23:20.526 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6812/27952 v1:172.21.15.117:6813/27952 exists,up ddca42d1-70ca-415f-bde3-1e3169f8ce81 2023-01-25T12:23:20.526 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.148:6804/28013 v1:172.21.15.148:6805/28013 exists,up 82366822-5d13-4c35-97ae-065f115f107b 2023-01-25T12:23:20.526 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.148:6811/28011 v1:172.21.15.148:6813/28011 exists,up e09c9352-5d33-4e18-978e-4af5b0ff771e 2023-01-25T12:23:20.526 INFO:teuthology.orchestra.run.smithi117.stdout:osd.6 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.148:6808/28014 v1:172.21.15.148:6809/28014 exists,up 3331e9a0-bf3a-4eff-b876-56b4bb973349 2023-01-25T12:23:20.526 INFO:teuthology.orchestra.run.smithi117.stdout:osd.7 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.148:6800/28012 v1:172.21.15.148:6801/28012 exists,up d77ce8ca-2885-4567-b2e1-2d74433e3bbf 2023-01-25T12:23:20.542 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6804/27954 v1:172.21.15.117:6805/27954 exists,up 68adfa07-6535-47c4-8201-28ea95fbc9ca', 'osd.1 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6808/27955 v1:172.21.15.117:6809/27955 exists,up 408c3819-f2b1-4e02-bca2-533176953430', 'osd.2 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6800/27953 v1:172.21.15.117:6801/27953 exists,up 413eac7e-c4a5-4da6-9adb-45021d8a7e34', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.117:6812/27952 v1:172.21.15.117:6813/27952 exists,up ddca42d1-70ca-415f-bde3-1e3169f8ce81', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.148:6804/28013 v1:172.21.15.148:6805/28013 exists,up 82366822-5d13-4c35-97ae-065f115f107b', 'osd.5 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.148:6811/28011 v1:172.21.15.148:6813/28011 exists,up e09c9352-5d33-4e18-978e-4af5b0ff771e', 'osd.6 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.148:6808/28014 v1:172.21.15.148:6809/28014 exists,up 3331e9a0-bf3a-4eff-b876-56b4bb973349', 'osd.7 up in weight 1 up_from 13 up_thru 15 down_at 0 last_clean_interval [0,0) v1:172.21.15.148:6800/28012 v1:172.21.15.148:6801/28012 exists,up d77ce8ca-2885-4567-b2e1-2d74433e3bbf'] 2023-01-25T12:23:20.543 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-01-25T12:23:20.645 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-01-25T12:23:20.645 INFO:teuthology.orchestra.run.smithi117.stdout: "name": "mon.a", 2023-01-25T12:23:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster": "ceph", 2023-01-25T12:23:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-01-25T12:23:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "admin_socket_mode": "", 2023-01-25T12:23:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-01-25T12:23:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_client_required": "cephx, none", 2023-01-25T12:23:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_cluster_required": "cephx", 2023-01-25T12:23:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_debug": "true", 2023-01-25T12:23:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-01-25T12:23:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-01-25T12:23:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_service_required": "cephx", 2023-01-25T12:23:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_service_ticket_ttl": "240.000000", 2023-01-25T12:23:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_supported": "cephx", 2023-01-25T12:23:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_aio": "true", 2023-01-25T12:23:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_aio_max_queue_depth": "1024", 2023-01-25T12:23:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_aio_poll_ms": "250", 2023-01-25T12:23:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_aio_reap_max": "16", 2023-01-25T12:23:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_async_discard": "false", 2023-01-25T12:23:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_block_size": "4096", 2023-01-25T12:23:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_debug_aio": "false", 2023-01-25T12:23:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-01-25T12:23:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-01-25T12:23:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_debug_inflight_ios": "false", 2023-01-25T12:23:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_enable_discard": "false", 2023-01-25T12:23:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_flock_retry": "3", 2023-01-25T12:23:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_flock_retry_interval": "0.100000", 2023-01-25T12:23:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_inject_crash": "0", 2023-01-25T12:23:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_inject_crash_flush_delay": "2", 2023-01-25T12:23:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_ioring": "false", 2023-01-25T12:23:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_ioring_hipri": "false", 2023-01-25T12:23:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_ioring_sqthread_poll": "false", 2023-01-25T12:23:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-01-25T12:23:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_read_buffer_alignment": "4096", 2023-01-25T12:23:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-01-25T12:23:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: "bdev_type": "", 2023-01-25T12:23:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_alloc_size": "1048576", 2023-01-25T12:23:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_allocator": "hybrid", 2023-01-25T12:23:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_buffered_io": "true", 2023-01-25T12:23:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_check_for_zeros": "false", 2023-01-25T12:23:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_check_volume_selector_often": "false", 2023-01-25T12:23:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-01-25T12:23:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_compact_log_sync": "false", 2023-01-25T12:23:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-01-25T12:23:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_log_compact_min_size": "16777216", 2023-01-25T12:23:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_log_replay_check_allocations": "true", 2023-01-25T12:23:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_max_log_runway": "4194304", 2023-01-25T12:23:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_max_prefetch": "1048576", 2023-01-25T12:23:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_min_flush_size": "524288", 2023-01-25T12:23:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_min_log_runway": "1048576", 2023-01-25T12:23:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_replay_recovery": "false", 2023-01-25T12:23:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-01-25T12:23:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_shared_alloc_size": "65536", 2023-01-25T12:23:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_sync_write": "false", 2023-01-25T12:23:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-01-25T12:23:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-01-25T12:23:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-01-25T12:23:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_allocation_from_file": "true", 2023-01-25T12:23:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_allocator": "hybrid", 2023-01-25T12:23:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-01-25T12:23:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-01-25T12:23:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-01-25T12:23:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-01-25T12:23:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-01-25T12:23:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-01-25T12:23:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blobid_prealloc": "10240", 2023-01-25T12:23:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_create": "true", 2023-01-25T12:23:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_db_create": "false", 2023-01-25T12:23:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_db_path": "", 2023-01-25T12:23:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_db_size": "0", 2023-01-25T12:23:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_path": "", 2023-01-25T12:23:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_preallocate_file": "false", 2023-01-25T12:23:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_size": "107374182400", 2023-01-25T12:23:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_wal_create": "false", 2023-01-25T12:23:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_wal_path": "", 2023-01-25T12:23:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_block_wal_size": "100663296", 2023-01-25T12:23:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_bluefs": "true", 2023-01-25T12:23:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-01-25T12:23:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_bluefs_env_mirror": "false", 2023-01-25T12:23:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-01-25T12:23:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-01-25T12:23:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T12:23:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T12:23:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-01-25T12:23:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T12:23:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_autotune": "true", 2023-01-25T12:23:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-01-25T12:23:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-01-25T12:23:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-01-25T12:23:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-01-25T12:23:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_size": "0", 2023-01-25T12:23:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-01-25T12:23:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-01-25T12:23:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-01-25T12:23:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-01-25T12:23:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_type": "2q", 2023-01-25T12:23:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-01-25T12:23:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_clone_cow": "true", 2023-01-25T12:23:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_algorithm": "snappy", 2023-01-25T12:23:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_max_blob_size": "0", 2023-01-25T12:23:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-01-25T12:23:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-01-25T12:23:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_min_blob_size": "0", 2023-01-25T12:23:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-01-25T12:23:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-01-25T12:23:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_mode": "none", 2023-01-25T12:23:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-01-25T12:23:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_csum_type": "crc32c", 2023-01-25T12:23:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_enforce_settings": "default", 2023-01-25T12:23:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_freelist": "false", 2023-01-25T12:23:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_fsck_abort": "false", 2023-01-25T12:23:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-01-25T12:23:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_inject_bug21040": "false", 2023-01-25T12:23:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-01-25T12:23:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_inject_read_err": "false", 2023-01-25T12:23:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_legacy_omap": "false", 2023-01-25T12:23:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-01-25T12:23:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-01-25T12:23:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-01-25T12:23:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-01-25T12:23:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_prefill": "0.000000", 2023-01-25T12:23:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-01-25T12:23:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-01-25T12:23:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-01-25T12:23:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_small_allocations": "0", 2023-01-25T12:23:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-01-25T12:23:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_default_buffered_read": "true", 2023-01-25T12:23:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_default_buffered_write": "false", 2023-01-25T12:23:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_deferred_batch_ops": "0", 2023-01-25T12:23:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-01-25T12:23:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-01-25T12:23:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-01-25T12:23:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-01-25T12:23:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-01-25T12:23:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-01-25T12:23:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-01-25T12:23:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fail_eio": "false", 2023-01-25T12:23:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-01-25T12:23:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-01-25T12:23:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-01-25T12:23:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-01-25T12:23:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_on_mkfs": "true", 2023-01-25T12:23:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-01-25T12:23:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_on_mount": "false", 2023-01-25T12:23:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-01-25T12:23:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_on_umount": "false", 2023-01-25T12:23:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-01-25T12:23:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-01-25T12:23:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-01-25T12:23:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-01-25T12:23:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-01-25T12:23:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-01-25T12:23:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-01-25T12:23:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-01-25T12:23:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_ignore_data_csum": "false", 2023-01-25T12:23:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-01-25T12:23:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_kvbackend": "rocksdb", 2023-01-25T12:23:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-01-25T12:23:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-01-25T12:23:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_log_op_age": "5.000000", 2023-01-25T12:23:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_max_alloc_size": "0", 2023-01-25T12:23:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_max_blob_size": "0", 2023-01-25T12:23:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-01-25T12:23:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-01-25T12:23:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_max_defer_interval": "3.000000", 2023-01-25T12:23:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_max_deferred_txc": "32", 2023-01-25T12:23:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_min_alloc_size": "0", 2023-01-25T12:23:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-01-25T12:23:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-01-25T12:23:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_nid_prealloc": "1024", 2023-01-25T12:23:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_prefer_deferred_size": "0", 2023-01-25T12:23:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-01-25T12:23:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-01-25T12:23:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_qfsck_on_mount": "true", 2023-01-25T12:23:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_retry_disk_reads": "3", 2023-01-25T12:23:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_rocksdb_cf": "true", 2023-01-25T12:23:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2023-01-25T12:23:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=128,min_write_buffer_number_to_merge=16,compaction_style=kCompactionStyleLevel,write_buffer_size=8388608,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0,ttl=21600", 2023-01-25T12:23:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_rocksdb_options_annex": "", 2023-01-25T12:23:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_spdk_coremask": "0x1", 2023-01-25T12:23:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_spdk_io_sleep": "5", 2023-01-25T12:23:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_spdk_max_io_completion": "0", 2023-01-25T12:23:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_spdk_mem": "512", 2023-01-25T12:23:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_sync_submit_transaction": "false", 2023-01-25T12:23:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_throttle_bytes": "67108864", 2023-01-25T12:23:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_throttle_cost_per_io": "0", 2023-01-25T12:23:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-01-25T12:23:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-01-25T12:23:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-01-25T12:23:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-01-25T12:23:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_tracing": "false", 2023-01-25T12:23:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-01-25T12:23:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-01-25T12:23:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_volume_selection_reserved": "0", 2023-01-25T12:23:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-01-25T12:23:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-01-25T12:23:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-01-25T12:23:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-01-25T12:23:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-01-25T12:23:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-01-25T12:23:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_zero_block_detection": "false", 2023-01-25T12:23:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-01-25T12:23:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_action_update_interval": "2", 2023-01-25T12:23:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-01-25T12:23:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-01-25T12:23:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-01-25T12:23:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-01-25T12:23:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_mount_timeout": "10", 2023-01-25T12:23:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-01-25T12:23:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-01-25T12:23:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-01-25T12:23:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-01-25T12:23:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-01-25T12:23:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-01-25T12:23:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "cephx_cluster_require_signatures": "false", 2023-01-25T12:23:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "cephx_cluster_require_version": "2", 2023-01-25T12:23:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "cephx_require_signatures": "false", 2023-01-25T12:23:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "cephx_require_version": "2", 2023-01-25T12:23:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "cephx_service_require_signatures": "false", 2023-01-25T12:23:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "cephx_service_require_version": "2", 2023-01-25T12:23:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "cephx_sign_messages": "true", 2023-01-25T12:23:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "chdir": "", 2023-01-25T12:23:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_acl_type": "", 2023-01-25T12:23:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_asio_thread_count": "2", 2023-01-25T12:23:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_cache_mid": "0.750000", 2023-01-25T12:23:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: "client_cache_size": "16384", 2023-01-25T12:23:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: "client_caps_release_delay": "5", 2023-01-25T12:23:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: "client_check_pool_perm": "true", 2023-01-25T12:23:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: "client_collect_and_send_global_metrics": "false", 2023-01-25T12:23:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: "client_debug_force_sync_read": "false", 2023-01-25T12:23:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_debug_getattr_caps": "false", 2023-01-25T12:23:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_debug_inject_tick_delay": "0", 2023-01-25T12:23:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-01-25T12:23:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_die_on_failed_remount": "false", 2023-01-25T12:23:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_dirsize_rbytes": "true", 2023-01-25T12:23:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_force_lazyio": "false", 2023-01-25T12:23:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_fs": "", 2023-01-25T12:23:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_inject_fixed_oldest_tid": "false", 2023-01-25T12:23:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_inject_release_failure": "false", 2023-01-25T12:23:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_max_inline_size": "4096", 2023-01-25T12:23:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_mds_namespace": "", 2023-01-25T12:23:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_metadata": "", 2023-01-25T12:23:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_mount_gid": "-1", 2023-01-25T12:23:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_mount_timeout": "300", 2023-01-25T12:23:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_mount_uid": "-1", 2023-01-25T12:23:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_mountpoint": "/", 2023-01-25T12:23:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: "client_notify_timeout": "10", 2023-01-25T12:23:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: "client_oc": "true", 2023-01-25T12:23:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: "client_oc_max_dirty": "104857600", 2023-01-25T12:23:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: "client_oc_max_dirty_age": "5.000000", 2023-01-25T12:23:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: "client_oc_max_objects": "1000", 2023-01-25T12:23:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client_oc_size": "209715200", 2023-01-25T12:23:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client_oc_target_dirty": "8388608", 2023-01-25T12:23:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client_permissions": "true", 2023-01-25T12:23:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client_quota": "true", 2023-01-25T12:23:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client_quota_df": "true", 2023-01-25T12:23:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: "client_readahead_max_bytes": "0", 2023-01-25T12:23:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: "client_readahead_max_periods": "4", 2023-01-25T12:23:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: "client_readahead_min": "131072", 2023-01-25T12:23:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: "client_reconnect_stale": "false", 2023-01-25T12:23:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: "client_shutdown_timeout": "30", 2023-01-25T12:23:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: "client_snapdir": ".snap", 2023-01-25T12:23:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: "client_tick_interval": "1", 2023-01-25T12:23:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: "client_trace": "", 2023-01-25T12:23:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: "client_try_dentry_invalidate": "false", 2023-01-25T12:23:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "client_use_faked_inos": "false", 2023-01-25T12:23:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "client_use_random_mds": "false", 2023-01-25T12:23:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "clog_to_graylog": "false", 2023-01-25T12:23:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-01-25T12:23:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "clog_to_graylog_port": "12201", 2023-01-25T12:23:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "clog_to_monitors": "default=true", 2023-01-25T12:23:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "clog_to_syslog": "false", 2023-01-25T12:23:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-01-25T12:23:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "clog_to_syslog_level": "info", 2023-01-25T12:23:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_addr": "-", 2023-01-25T12:23:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_network": "", 2023-01-25T12:23:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_network_interface": "", 2023-01-25T12:23:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: "compressor_zlib_isal": "false", 2023-01-25T12:23:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: "compressor_zlib_level": "5", 2023-01-25T12:23:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: "compressor_zlib_winsize": "-15", 2023-01-25T12:23:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: "compressor_zstd_level": "1", 2023-01-25T12:23:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-01-25T12:23:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-01-25T12:23:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "crimson_alien_op_num_threads": "6", 2023-01-25T12:23:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "crimson_alien_thread_cpu_cores": "", 2023-01-25T12:23:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "crimson_osd_obc_lru_size": "10", 2023-01-25T12:23:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-01-25T12:23:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "crimson_seastar_smp": "1", 2023-01-25T12:23:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "crush_location": "", 2023-01-25T12:23:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "crush_location_hook": "", 2023-01-25T12:23:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "crush_location_hook_timeout": "10", 2023-01-25T12:23:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "daemonize": "false", 2023-01-25T12:23:20.703 INFO:teuthology.orchestra.run.smithi117.stdout: "daos_pool": "tank", 2023-01-25T12:23:20.703 INFO:teuthology.orchestra.run.smithi117.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-01-25T12:23:20.703 INFO:teuthology.orchestra.run.smithi117.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-01-25T12:23:20.703 INFO:teuthology.orchestra.run.smithi117.stdout: "dbstore_db_name_prefix": "dbstore", 2023-01-25T12:23:20.703 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_alienstore": "0/5", 2023-01-25T12:23:20.704 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_allow_any_pool_priority": "false", 2023-01-25T12:23:20.704 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_asok": "1/5", 2023-01-25T12:23:20.704 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_asok_assert_abort": "false", 2023-01-25T12:23:20.704 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_asserts_on_shutdown": "true", 2023-01-25T12:23:20.704 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_auth": "20/20", 2023-01-25T12:23:20.705 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_bdev": "1/3", 2023-01-25T12:23:20.705 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_bluefs": "1/5", 2023-01-25T12:23:20.705 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_bluestore": "1/5", 2023-01-25T12:23:20.705 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_buffer": "0/1", 2023-01-25T12:23:20.705 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_ceph_exporter": "1/5", 2023-01-25T12:23:20.706 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_cephfs_mirror": "0/5", 2023-01-25T12:23:20.706 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_cephsqlite": "0/5", 2023-01-25T12:23:20.706 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_client": "0/5", 2023-01-25T12:23:20.706 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_compressor": "1/5", 2023-01-25T12:23:20.706 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_context": "0/1", 2023-01-25T12:23:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_crush": "1/1", 2023-01-25T12:23:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_crypto": "1/5", 2023-01-25T12:23:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_cyanstore": "0/5", 2023-01-25T12:23:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_deliberately_leak_memory": "false", 2023-01-25T12:23:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_disable_randomized_ping": "false", 2023-01-25T12:23:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_dpdk": "1/5", 2023-01-25T12:23:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_eventtrace": "1/5", 2023-01-25T12:23:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_filer": "0/1", 2023-01-25T12:23:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_filestore": "1/3", 2023-01-25T12:23:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_finisher": "1/1", 2023-01-25T12:23:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_fuse": "1/5", 2023-01-25T12:23:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_heartbeat_testing_span": "0", 2023-01-25T12:23:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_heartbeatmap": "1/5", 2023-01-25T12:23:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_immutable_obj_cache": "0/5", 2023-01-25T12:23:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_javaclient": "1/5", 2023-01-25T12:23:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_journal": "1/3", 2023-01-25T12:23:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_journaler": "0/5", 2023-01-25T12:23:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_kstore": "1/5", 2023-01-25T12:23:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_leveldb": "4/5", 2023-01-25T12:23:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_lockdep": "0/1", 2023-01-25T12:23:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mclock": "1/5", 2023-01-25T12:23:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mds": "1/5", 2023-01-25T12:23:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mds_balancer": "1/5", 2023-01-25T12:23:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mds_locker": "1/5", 2023-01-25T12:23:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mds_log": "1/5", 2023-01-25T12:23:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mds_log_expire": "1/5", 2023-01-25T12:23:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mds_migrator": "1/5", 2023-01-25T12:23:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_memstore": "1/5", 2023-01-25T12:23:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mgr": "2/5", 2023-01-25T12:23:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mgrc": "1/5", 2023-01-25T12:23:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_mon": "20/20", 2023-01-25T12:23:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_monc": "0/10", 2023-01-25T12:23:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_ms": "1/1", 2023-01-25T12:23:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_none": "0/5", 2023-01-25T12:23:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_objclass": "0/5", 2023-01-25T12:23:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_objectcacher": "0/5", 2023-01-25T12:23:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_objecter": "0/1", 2023-01-25T12:23:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_optracker": "0/5", 2023-01-25T12:23:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_osd": "1/5", 2023-01-25T12:23:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_paxos": "20/20", 2023-01-25T12:23:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_perfcounter": "1/5", 2023-01-25T12:23:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_prioritycache": "1/5", 2023-01-25T12:23:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rados": "0/5", 2023-01-25T12:23:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rbd": "0/5", 2023-01-25T12:23:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rbd_mirror": "0/5", 2023-01-25T12:23:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rbd_pwl": "0/5", 2023-01-25T12:23:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rbd_replay": "0/5", 2023-01-25T12:23:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_refs": "0/0", 2023-01-25T12:23:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_reserver": "1/1", 2023-01-25T12:23:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rgw": "1/5", 2023-01-25T12:23:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rgw_access": "1/5", 2023-01-25T12:23:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rgw_datacache": "1/5", 2023-01-25T12:23:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rgw_dbstore": "1/5", 2023-01-25T12:23:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rgw_flight": "1/5", 2023-01-25T12:23:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rgw_sync": "1/5", 2023-01-25T12:23:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_rocksdb": "4/5", 2023-01-25T12:23:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore": "0/5", 2023-01-25T12:23:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_backref": "0/5", 2023-01-25T12:23:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_cache": "0/5", 2023-01-25T12:23:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_cleaner": "0/5", 2023-01-25T12:23:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_device": "0/5", 2023-01-25T12:23:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_epm": "0/5", 2023-01-25T12:23:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-01-25T12:23:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_journal": "0/5", 2023-01-25T12:23:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_lba": "0/5", 2023-01-25T12:23:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_odata": "0/5", 2023-01-25T12:23:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_omap": "0/5", 2023-01-25T12:23:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_onode": "0/5", 2023-01-25T12:23:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_t": "0/5", 2023-01-25T12:23:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_seastore_tm": "0/5", 2023-01-25T12:23:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_striper": "0/1", 2023-01-25T12:23:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_test": "0/5", 2023-01-25T12:23:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_throttle": "1/1", 2023-01-25T12:23:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_timer": "0/1", 2023-01-25T12:23:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "debug_tp": "0/5", 2023-01-25T12:23:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "device_failure_prediction_mode": "none", 2023-01-25T12:23:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-01-25T12:23:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2023-01-25T12:23:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: "err_to_graylog": "false", 2023-01-25T12:23:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: "err_to_journald": "false", 2023-01-25T12:23:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: "err_to_stderr": "true", 2023-01-25T12:23:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: "err_to_syslog": "false", 2023-01-25T12:23:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event_tracing": "false", 2023-01-25T12:23:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "exporter_addr": "0.0.0.0", 2023-01-25T12:23:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "exporter_http_port": "9926", 2023-01-25T12:23:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "exporter_prio_limit": "5", 2023-01-25T12:23:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-01-25T12:23:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: "exporter_sort_metrics": "true", 2023-01-25T12:23:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: "exporter_stats_period": "5", 2023-01-25T12:23:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: "fake_statfs_for_testing": "0", 2023-01-25T12:23:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: "fatal_signal_handlers": "true", 2023-01-25T12:23:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: "filer_max_purge_ops": "10", 2023-01-25T12:23:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: "filer_max_truncate_ops": "128", 2023-01-25T12:23:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_apply_finisher_threads": "1", 2023-01-25T12:23:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_blackhole": "false", 2023-01-25T12:23:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_btrfs_clone_range": "true", 2023-01-25T12:23:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_btrfs_snap": "true", 2023-01-25T12:23:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_caller_concurrency": "10", 2023-01-25T12:23:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_collect_device_partition_information": "true", 2023-01-25T12:23:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_commit_timeout": "600.000000", 2023-01-25T12:23:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_debug_inject_read_err": "false", 2023-01-25T12:23:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_debug_omap_check": "false", 2023-01-25T12:23:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_debug_random_read_err": "0.000000", 2023-01-25T12:23:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_debug_verify_split": "false", 2023-01-25T12:23:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_dump_file": "", 2023-01-25T12:23:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-01-25T12:23:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-01-25T12:23:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_fadvise": "true", 2023-01-25T12:23:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_fail_eio": "true", 2023-01-25T12:23:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_fd_cache_shards": "16", 2023-01-25T12:23:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_fd_cache_size": "128", 2023-01-25T12:23:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_fiemap": "false", 2023-01-25T12:23:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_fiemap_threshold": "4096", 2023-01-25T12:23:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-01-25T12:23:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_index_retry_probability": "0.000000", 2023-01-25T12:23:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_inject_stall": "0", 2023-01-25T12:23:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_journal_parallel": "false", 2023-01-25T12:23:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_journal_trailing": "false", 2023-01-25T12:23:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_journal_writeahead": "false", 2023-01-25T12:23:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_kill_at": "0", 2023-01-25T12:23:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-01-25T12:23:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_inline_xattr_size": "0", 2023-01-25T12:23:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-01-25T12:23:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-01-25T12:23:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-01-25T12:23:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_inline_xattrs": "0", 2023-01-25T12:23:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-01-25T12:23:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_inline_xattrs_other": "2", 2023-01-25T12:23:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-01-25T12:23:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_sync_interval": "5.000000", 2023-01-25T12:23:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_xattr_value_size": "0", 2023-01-25T12:23:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-01-25T12:23:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-01-25T12:23:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-01-25T12:23:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_merge_threshold": "-10", 2023-01-25T12:23:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_min_sync_interval": "0.010000", 2023-01-25T12:23:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_odsync_write": "false", 2023-01-25T12:23:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_omap_backend": "rocksdb", 2023-01-25T12:23:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_omap_backend_path": "", 2023-01-25T12:23:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_omap_header_cache_size": "1024", 2023-01-25T12:23:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_ondisk_finisher_threads": "1", 2023-01-25T12:23:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-01-25T12:23:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_op_thread_timeout": "60", 2023-01-25T12:23:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_op_threads": "2", 2023-01-25T12:23:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_punch_hole": "false", 2023-01-25T12:23:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-01-25T12:23:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-01-25T12:23:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-01-25T12:23:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-01-25T12:23:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-01-25T12:23:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_max_bytes": "104857600", 2023-01-25T12:23:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-01-25T12:23:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-01-25T12:23:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-01-25T12:23:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_queue_max_ops": "50", 2023-01-25T12:23:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-01-25T12:23:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_seek_data_hole": "false", 2023-01-25T12:23:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_sloppy_crc": "false", 2023-01-25T12:23:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-01-25T12:23:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_splice": "false", 2023-01-25T12:23:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_split_multiple": "2", 2023-01-25T12:23:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_split_rand_factor": "20", 2023-01-25T12:23:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_update_to": "1000", 2023-01-25T12:23:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-01-25T12:23:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-01-25T12:23:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-01-25T12:23:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-01-25T12:23:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-01-25T12:23:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-01-25T12:23:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_enable": "true", 2023-01-25T12:23:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-01-25T12:23:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-01-25T12:23:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-01-25T12:23:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-01-25T12:23:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-01-25T12:23:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-01-25T12:23:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_xfs_extsize": "false", 2023-01-25T12:23:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "filestore_zfs_snap": "false", 2023-01-25T12:23:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "fio_dir": "/tmp/fio", 2023-01-25T12:23:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "fsid": "814e11f4-6e34-411d-8202-e91b5ec6cfee", 2023-01-25T12:23:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_allow_other": "true", 2023-01-25T12:23:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_atomic_o_trunc": "true", 2023-01-25T12:23:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_big_writes": "true", 2023-01-25T12:23:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_debug": "false", 2023-01-25T12:23:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_default_permissions": "false", 2023-01-25T12:23:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_disable_pagecache": "false", 2023-01-25T12:23:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_max_write": "0", 2023-01-25T12:23:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_multithreaded": "true", 2023-01-25T12:23:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_require_active_mds": "true", 2023-01-25T12:23:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_set_user_groups": "true", 2023-01-25T12:23:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_splice_move": "true", 2023-01-25T12:23:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_splice_read": "true", 2023-01-25T12:23:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_splice_write": "true", 2023-01-25T12:23:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_syncfs_on_mksnap": "true", 2023-01-25T12:23:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "fuse_use_invalidate_cb": "true", 2023-01-25T12:23:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-01-25T12:23:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "gss_target_name": "ceph", 2023-01-25T12:23:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "heartbeat_file": "", 2023-01-25T12:23:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "heartbeat_inject_failure": "0", 2023-01-25T12:23:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "heartbeat_interval": "5", 2023-01-25T12:23:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "host": "smithi117", 2023-01-25T12:23:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-01-25T12:23:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-01-25T12:23:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_max_size": "1073741824", 2023-01-25T12:23:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-01-25T12:23:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-01-25T12:23:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-01-25T12:23:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-01-25T12:23:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-01-25T12:23:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-01-25T12:23:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-01-25T12:23:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-01-25T12:23:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-01-25T12:23:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: "immutable_object_cache_watermark": "0.900000", 2023-01-25T12:23:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: "inject_early_sigterm": "false", 2023-01-25T12:23:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "jaeger_tracing_enable": "false", 2023-01-25T12:23:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_aio": "true", 2023-01-25T12:23:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_align_min_size": "65536", 2023-01-25T12:23:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_block_align": "true", 2023-01-25T12:23:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_block_size": "4096", 2023-01-25T12:23:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_dio": "true", 2023-01-25T12:23:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_discard": "false", 2023-01-25T12:23:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_force_aio": "false", 2023-01-25T12:23:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_ignore_corruption": "false", 2023-01-25T12:23:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_max_write_bytes": "10485760", 2023-01-25T12:23:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_max_write_entries": "100", 2023-01-25T12:23:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_replay_from": "0", 2023-01-25T12:23:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_throttle_high_multiple": "0.000000", 2023-01-25T12:23:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-01-25T12:23:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-01-25T12:23:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_throttle_max_multiple": "0.000000", 2023-01-25T12:23:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_write_header_frequency": "0", 2023-01-25T12:23:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "journal_zero_on_create": "false", 2023-01-25T12:23:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "journaler_prefetch_periods": "10", 2023-01-25T12:23:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "journaler_prezero_periods": "5", 2023-01-25T12:23:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "journaler_write_head_interval": "15", 2023-01-25T12:23:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "", 2023-01-25T12:23:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "keyfile": "", 2023-01-25T12:23:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-01-25T12:23:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_backend": "rocksdb", 2023-01-25T12:23:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_default_stripe_size": "65536", 2023-01-25T12:23:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_fsck_on_mount": "false", 2023-01-25T12:23:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_fsck_on_mount_deep": "true", 2023-01-25T12:23:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_max_bytes": "67108864", 2023-01-25T12:23:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_max_ops": "512", 2023-01-25T12:23:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_nid_prealloc": "1024", 2023-01-25T12:23:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_onode_map_size": "1024", 2023-01-25T12:23:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-01-25T12:23:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_sync_submit_transaction": "false", 2023-01-25T12:23:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "kstore_sync_transaction": "false", 2023-01-25T12:23:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_block_size": "65536", 2023-01-25T12:23:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_bloom_size": "0", 2023-01-25T12:23:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_cache_size": "536870912", 2023-01-25T12:23:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_compact_on_mount": "false", 2023-01-25T12:23:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_compression": "false", 2023-01-25T12:23:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_log": "", 2023-01-25T12:23:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_log_to_ceph_log": "true", 2023-01-25T12:23:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_max_open_files": "0", 2023-01-25T12:23:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_paranoid": "false", 2023-01-25T12:23:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "leveldb_write_buffer_size": "33554432", 2023-01-25T12:23:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "librados_thread_count": "2", 2023-01-25T12:23:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "lockdep": "false", 2023-01-25T12:23:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "lockdep_force_backtrace": "false", 2023-01-25T12:23:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "log_coarse_timestamps": "true", 2023-01-25T12:23:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-01-25T12:23:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "log_flush_on_exit": "false", 2023-01-25T12:23:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "log_graylog_host": "127.0.0.1", 2023-01-25T12:23:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "log_graylog_port": "12201", 2023-01-25T12:23:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "log_max_new": "1000", 2023-01-25T12:23:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "log_max_recent": "10000", 2023-01-25T12:23:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "log_stderr_prefix": "", 2023-01-25T12:23:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "log_stop_at_utilization": "0.970000", 2023-01-25T12:23:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "log_to_file": "true", 2023-01-25T12:23:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: "log_to_graylog": "false", 2023-01-25T12:23:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: "log_to_journald": "false", 2023-01-25T12:23:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: "log_to_stderr": "false", 2023-01-25T12:23:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: "log_to_syslog": "false", 2023-01-25T12:23:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "max_rotating_auth_attempts": "10", 2023-01-25T12:23:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_action_on_write_error": "1", 2023-01-25T12:23:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_alternate_name_max": "8192", 2023-01-25T12:23:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_asio_thread_count": "2", 2023-01-25T12:23:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_export_pin": "true", 2023-01-25T12:23:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_fragment_dirs": "true", 2023-01-25T12:23:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-01-25T12:23:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_fragment_interval": "5", 2023-01-25T12:23:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_fragment_size_max": "100000", 2023-01-25T12:23:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_idle_threshold": "0.000000", 2023-01-25T12:23:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_interval": "10", 2023-01-25T12:23:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_max": "-1", 2023-01-25T12:23:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_max_until": "-1", 2023-01-25T12:23:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_merge_size": "50", 2023-01-25T12:23:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_midchunk": "0.300000", 2023-01-25T12:23:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_min_rebalance": "0.100000", 2023-01-25T12:23:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_min_start": "0.200000", 2023-01-25T12:23:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_minchunk": "0.001000", 2023-01-25T12:23:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_mode": "0", 2023-01-25T12:23:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_need_max": "1.200000", 2023-01-25T12:23:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_need_min": "0.800000", 2023-01-25T12:23:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-01-25T12:23:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_sample_interval": "3.000000", 2023-01-25T12:23:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_split_bits": "3", 2023-01-25T12:23:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_split_rd": "25000.000000", 2023-01-25T12:23:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_split_size": "10000", 2023-01-25T12:23:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_split_wr": "10000.000000", 2023-01-25T12:23:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_target_decay": "10.000000", 2023-01-25T12:23:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-01-25T12:23:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_beacon_grace": "15.000000", 2023-01-25T12:23:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_beacon_interval": "4.000000", 2023-01-25T12:23:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_beacon_mon_down_grace": "60", 2023-01-25T12:23:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache_memory_limit": "4294967296", 2023-01-25T12:23:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache_mid": "0.700000", 2023-01-25T12:23:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache_release_free_interval": "10", 2023-01-25T12:23:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache_reservation": "0.050000", 2023-01-25T12:23:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-01-25T12:23:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache_trim_interval": "1", 2023-01-25T12:23:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache_trim_threshold": "262144", 2023-01-25T12:23:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-01-25T12:23:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-01-25T12:23:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_client_delegate_inos_pct": "50", 2023-01-25T12:23:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_client_prealloc_inos": "1000", 2023-01-25T12:23:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-01-25T12:23:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_connect_bootstrapping": "false", 2023-01-25T12:23:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_damage_table_max_entries": "10000", 2023-01-25T12:23:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-01-25T12:23:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_debug_auth_pins": "false", 2023-01-25T12:23:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_debug_frag": "false", 2023-01-25T12:23:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_debug_scatterstat": "false", 2023-01-25T12:23:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_debug_subtrees": "false", 2023-01-25T12:23:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_decay_halflife": "5.000000", 2023-01-25T12:23:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_default_dir_hash": "2", 2023-01-25T12:23:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_defer_session_stale": "true", 2023-01-25T12:23:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_deny_all_reconnect": "false", 2023-01-25T12:23:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dir_keys_per_op": "16384", 2023-01-25T12:23:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dir_max_commit_size": "10", 2023-01-25T12:23:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dir_max_entries": "0", 2023-01-25T12:23:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dir_prefetch": "true", 2023-01-25T12:23:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dirstat_min_interval": "1.000000", 2023-01-25T12:23:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dump_cache_after_rejoin": "false", 2023-01-25T12:23:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dump_cache_on_map": "false", 2023-01-25T12:23:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dump_cache_threshold_file": "0", 2023-01-25T12:23:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-01-25T12:23:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_early_reply": "true", 2023-01-25T12:23:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_enable_op_tracker": "true", 2023-01-25T12:23:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_enforce_unique_name": "true", 2023-01-25T12:23:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_export_ephemeral_distributed": "true", 2023-01-25T12:23:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-01-25T12:23:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_export_ephemeral_random": "true", 2023-01-25T12:23:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-01-25T12:23:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-01-25T12:23:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_forward_all_requests_to_auth": "false", 2023-01-25T12:23:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-01-25T12:23:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-01-25T12:23:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-01-25T12:23:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_health_cache_threshold": "1.500000", 2023-01-25T12:23:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_health_summarize_threshold": "10", 2023-01-25T12:23:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_heartbeat_grace": "15.000000", 2023-01-25T12:23:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_heartbeat_reset_grace": "1000", 2023-01-25T12:23:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_inject_health_dummy": "false", 2023-01-25T12:23:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_inject_migrator_session_race": "false", 2023-01-25T12:23:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-01-25T12:23:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_join_fs": "", 2023-01-25T12:23:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_journal_format": "1", 2023-01-25T12:23:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_create_at": "0", 2023-01-25T12:23:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_export_at": "0", 2023-01-25T12:23:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_import_at": "0", 2023-01-25T12:23:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_journal_at": "0", 2023-01-25T12:23:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_journal_expire_at": "0", 2023-01-25T12:23:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_journal_replay_at": "0", 2023-01-25T12:23:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_link_at": "0", 2023-01-25T12:23:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_mdstable_at": "0", 2023-01-25T12:23:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_openc_at": "0", 2023-01-25T12:23:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_kill_rename_at": "0", 2023-01-25T12:23:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log_events_per_segment": "1024", 2023-01-25T12:23:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log_max_events": "-1", 2023-01-25T12:23:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log_max_segments": "128", 2023-01-25T12:23:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log_pause": "false", 2023-01-25T12:23:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log_segment_size": "0", 2023-01-25T12:23:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log_skip_corrupt_events": "false", 2023-01-25T12:23:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log_warn_factor": "2.000000", 2023-01-25T12:23:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_caps_per_client": "1048576", 2023-01-25T12:23:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_completed_flushes": "100000", 2023-01-25T12:23:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_completed_requests": "100000", 2023-01-25T12:23:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_export_size": "20971520", 2023-01-25T12:23:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_file_recover": "32", 2023-01-25T12:23:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_purge_files": "64", 2023-01-25T12:23:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_purge_ops": "8192", 2023-01-25T12:23:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-01-25T12:23:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_retries_on_remount_failure": "5", 2023-01-25T12:23:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-01-25T12:23:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_snaps_per_dir": "100", 2023-01-25T12:23:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_max_xattr_pairs_size": "65536", 2023-01-25T12:23:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_metrics_update_interval": "2", 2023-01-25T12:23:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_min_caps_per_client": "100", 2023-01-25T12:23:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_min_caps_working_set": "10000", 2023-01-25T12:23:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-01-25T12:23:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_numa_node": "-1", 2023-01-25T12:23:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-01-25T12:23:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_op_complaint_time": "30.000000", 2023-01-25T12:23:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_op_history_duration": "600", 2023-01-25T12:23:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_op_history_size": "20", 2023-01-25T12:23:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_op_log_threshold": "5", 2023-01-25T12:23:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_ping_grace": "15", 2023-01-25T12:23:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_ping_interval": "5", 2023-01-25T12:23:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-01-25T12:23:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-01-25T12:23:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_recall_max_caps": "30000", 2023-01-25T12:23:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-01-25T12:23:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_recall_max_decay_threshold": "131072", 2023-01-25T12:23:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-01-25T12:23:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_recall_warning_threshold": "262144", 2023-01-25T12:23:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_reconnect_timeout": "45.000000", 2023-01-25T12:23:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_replay_interval": "1.000000", 2023-01-25T12:23:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-01-25T12:23:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-01-25T12:23:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_root_ino_gid": "0", 2023-01-25T12:23:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_root_ino_uid": "0", 2023-01-25T12:23:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-01-25T12:23:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_session_blocklist_on_evict": "true", 2023-01-25T12:23:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_session_blocklist_on_timeout": "true", 2023-01-25T12:23:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-01-25T12:23:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-01-25T12:23:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-01-25T12:23:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-01-25T12:23:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-01-25T12:23:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-01-25T12:23:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_shutdown_check": "0", 2023-01-25T12:23:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_skip_ino": "0", 2023-01-25T12:23:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sleep_rank_change": "0.000000", 2023-01-25T12:23:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_snap_max_uid": "4294967294", 2023-01-25T12:23:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_snap_min_uid": "0", 2023-01-25T12:23:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_snap_rstat": "false", 2023-01-25T12:23:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_standby_replay_damaged": "false", 2023-01-25T12:23:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_symlink_recovery": "true", 2023-01-25T12:23:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_task_status_update_interval": "2.000000", 2023-01-25T12:23:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_thrash_exports": "0", 2023-01-25T12:23:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_thrash_fragments": "0", 2023-01-25T12:23:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_tick_interval": "5.000000", 2023-01-25T12:23:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_valgrind_exit": "false", 2023-01-25T12:23:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_verify_backtrace": "1", 2023-01-25T12:23:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_verify_scatter": "false", 2023-01-25T12:23:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_wipe_ino_prealloc": "false", 2023-01-25T12:23:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_wipe_sessions": "false", 2023-01-25T12:23:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool_debug": "false", 2023-01-25T12:23:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: "memstore_debug_omit_block_device_write": "false", 2023-01-25T12:23:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: "memstore_device_bytes": "1073741824", 2023-01-25T12:23:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "memstore_page_set": "false", 2023-01-25T12:23:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "memstore_page_size": "65536", 2023-01-25T12:23:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_client_bytes": "134217728", 2023-01-25T12:23:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_client_messages": "512", 2023-01-25T12:23:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-01-25T12:23:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_connect_retry_interval": "1.000000", 2023-01-25T12:23:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-01-25T12:23:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-01-25T12:23:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_disabled_modules": "", 2023-01-25T12:23:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-01-25T12:23:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_max_pg_num_change": "128", 2023-01-25T12:23:20.798 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_mds_bytes": "134217728", 2023-01-25T12:23:20.798 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_mds_messages": "128", 2023-01-25T12:23:20.798 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-01-25T12:23:20.798 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_mon_bytes": "134217728", 2023-01-25T12:23:20.798 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_mon_messages": "128", 2023-01-25T12:23:20.798 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_osd_bytes": "536870912", 2023-01-25T12:23:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_osd_messages": "8192", 2023-01-25T12:23:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_pool": "true", 2023-01-25T12:23:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_service_beacon_grace": "60.000000", 2023-01-25T12:23:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_standby_modules": "true", 2023-01-25T12:23:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_stats_period": "5", 2023-01-25T12:23:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_stats_threshold": "5", 2023-01-25T12:23:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_tick_period": "2", 2023-01-25T12:23:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-01-25T12:23:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_accept_timeout_factor": "2.000000", 2023-01-25T12:23:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_allow_pool_delete": "true", 2023-01-25T12:23:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_allow_pool_size_one": "true", 2023-01-25T12:23:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_auth_validate_all_caps": "true", 2023-01-25T12:23:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-01-25T12:23:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-01-25T12:23:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_bytes": "104857600", 2023-01-25T12:23:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_directed_command_retry": "5", 2023-01-25T12:23:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_hunt_interval": "3.000000", 2023-01-25T12:23:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-01-25T12:23:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-01-25T12:23:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-01-25T12:23:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_hunt_parallel": "3", 2023-01-25T12:23:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_log_interval": "1.000000", 2023-01-25T12:23:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-01-25T12:23:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_ping_interval": "10.000000", 2023-01-25T12:23:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_client_ping_timeout": "30.000000", 2023-01-25T12:23:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_clock_drift_allowed": "1.000000", 2023-01-25T12:23:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-01-25T12:23:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-01-25T12:23:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_file_level": "debug", 2023-01-25T12:23:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_file": "true", 2023-01-25T12:23:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_graylog": "false", 2023-01-25T12:23:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-01-25T12:23:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-01-25T12:23:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_journald": "false", 2023-01-25T12:23:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_stderr": "false", 2023-01-25T12:23:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-01-25T12:23:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-01-25T12:23:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-01-25T12:23:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_compact_on_bootstrap": "false", 2023-01-25T12:23:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_compact_on_start": "false", 2023-01-25T12:23:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_compact_on_trim": "true", 2023-01-25T12:23:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_con_tracker_persist_interval": "10", 2023-01-25T12:23:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_con_tracker_score_halflife": "43200", 2023-01-25T12:23:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_config_key_max_entry_size": "65536", 2023-01-25T12:23:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_cpu_threads": "4", 2023-01-25T12:23:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_crush_min_required_version": "hammer", 2023-01-25T12:23:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_daemon_bytes": "419430400", 2023-01-25T12:23:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-01-25T12:23:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_data_avail_crit": "5", 2023-01-25T12:23:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_data_avail_warn": "5", 2023-01-25T12:23:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_data_size_warn": "16106127360", 2023-01-25T12:23:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_block_osdmap_trim": "false", 2023-01-25T12:23:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-01-25T12:23:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_dump_json": "false", 2023-01-25T12:23:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-01-25T12:23:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_dump_transactions": "false", 2023-01-25T12:23:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_extra_checks": "false", 2023-01-25T12:23:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-01-25T12:23:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-01-25T12:23:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_no_require_quincy": "false", 2023-01-25T12:23:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_no_require_reef": "false", 2023-01-25T12:23:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-01-25T12:23:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_delta_reset_interval": "10.000000", 2023-01-25T12:23:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_dns_srv_name": "ceph-mon", 2023-01-25T12:23:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_down_mkfs_grace": "120", 2023-01-25T12:23:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_election_default_strategy": "1", 2023-01-25T12:23:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_election_timeout": "5.000000", 2023-01-25T12:23:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-01-25T12:23:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_elector_ping_divisor": "2", 2023-01-25T12:23:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_elector_ping_timeout": "2.000000", 2023-01-25T12:23:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_enable_op_tracker": "true", 2023-01-25T12:23:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_fake_pool_delete": "false", 2023-01-25T12:23:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_force_quorum_join": "false", 2023-01-25T12:23:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_globalid_prealloc": "10000", 2023-01-25T12:23:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_health_detail_to_clog": "false", 2023-01-25T12:23:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_health_log_update_period": "5", 2023-01-25T12:23:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_health_max_detail": "50", 2023-01-25T12:23:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_health_to_clog": "true", 2023-01-25T12:23:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_health_to_clog_interval": "600", 2023-01-25T12:23:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-01-25T12:23:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_host": "[v1:172.21.15.117:6789],[v1:172.21.15.117:6790],[v1:172.21.15.148:6789]", 2023-01-25T12:23:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_host_override": "", 2023-01-25T12:23:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_initial_members": "", 2023-01-25T12:23:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-01-25T12:23:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-01-25T12:23:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-01-25T12:23:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-01-25T12:23:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_keyvaluedb": "rocksdb", 2023-01-25T12:23:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_lease": "5.000000", 2023-01-25T12:23:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-01-25T12:23:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-01-25T12:23:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_log_full_interval": "50", 2023-01-25T12:23:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_log_max": "10000", 2023-01-25T12:23:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_log_max_summary": "50", 2023-01-25T12:23:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_max_log_entries_per_event": "4096", 2023-01-25T12:23:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_max_log_epochs": "500", 2023-01-25T12:23:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_max_mdsmap_epochs": "500", 2023-01-25T12:23:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_max_mgrmap_epochs": "500", 2023-01-25T12:23:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_max_osd": "10000", 2023-01-25T12:23:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_max_pg_per_osd": "10000", 2023-01-25T12:23:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_max_pool_pg_num": "65536", 2023-01-25T12:23:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-01-25T12:23:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-01-25T12:23:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mds_force_trim_to": "0", 2023-01-25T12:23:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mds_skip_sanity": "false", 2023-01-25T12:23:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_memory_autotune": "true", 2023-01-25T12:23:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_memory_target": "2147483648", 2023-01-25T12:23:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mgr_beacon_grace": "30", 2023-01-25T12:23:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-01-25T12:23:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mgr_digest_period": "5", 2023-01-25T12:23:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mgr_inactive_grace": "60", 2023-01-25T12:23:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mgr_mkfs_grace": "240", 2023-01-25T12:23:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-01-25T12:23:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_min_osdmap_epochs": "50", 2023-01-25T12:23:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_op_complaint_time": "30", 2023-01-25T12:23:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_op_history_duration": "600", 2023-01-25T12:23:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_op_history_size": "20", 2023-01-25T12:23:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_op_history_slow_op_size": "20", 2023-01-25T12:23:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_op_history_slow_op_threshold": "10", 2023-01-25T12:23:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_op_log_threshold": "5", 2023-01-25T12:23:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-01-25T12:23:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-01-25T12:23:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-01-25T12:23:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_auto_mark_in": "false", 2023-01-25T12:23:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_auto_mark_new_in": "true", 2023-01-25T12:23:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-01-25T12:23:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-01-25T12:23:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_cache_size": "500", 2023-01-25T12:23:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_cache_size_min": "134217728", 2023-01-25T12:23:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_crush_smoke_test": "true", 2023-01-25T12:23:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_destroyed_out_interval": "600", 2023-01-25T12:23:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_down_out_interval": "600", 2023-01-25T12:23:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-01-25T12:23:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-01-25T12:23:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_force_trim_to": "0", 2023-01-25T12:23:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_full_ratio": "0.950000", 2023-01-25T12:23:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-01-25T12:23:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_laggy_halflife": "3600", 2023-01-25T12:23:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_laggy_max_interval": "300", 2023-01-25T12:23:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_laggy_weight": "0.300000", 2023-01-25T12:23:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-01-25T12:23:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_max_creating_pgs": "1024", 2023-01-25T12:23:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_max_initial_pgs": "1024", 2023-01-25T12:23:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_min_down_reporters": "2", 2023-01-25T12:23:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-01-25T12:23:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-01-25T12:23:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-01-25T12:23:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_prime_pg_temp": "true", 2023-01-25T12:23:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-01-25T12:23:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-01-25T12:23:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_report_timeout": "900", 2023-01-25T12:23:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-01-25T12:23:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-01-25T12:23:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_warn_num_repaired": "10", 2023-01-25T12:23:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osd_warn_op_age": "32.000000", 2023-01-25T12:23:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-01-25T12:23:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osdmap_full_prune_interval": "2", 2023-01-25T12:23:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osdmap_full_prune_min": "15", 2023-01-25T12:23:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_osdmap_full_prune_txsize": "2", 2023-01-25T12:23:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-01-25T12:23:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_pg_stuck_threshold": "60", 2023-01-25T12:23:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-01-25T12:23:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_pg_warn_min_objects": "10000", 2023-01-25T12:23:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_pg_warn_min_per_osd": "0", 2023-01-25T12:23:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-01-25T12:23:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_pool_quota_crit_threshold": "0", 2023-01-25T12:23:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_pool_quota_warn_threshold": "0", 2023-01-25T12:23:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_probe_timeout": "2.000000", 2023-01-25T12:23:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_reweight_max_change": "0.050000", 2023-01-25T12:23:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_reweight_max_osds": "4", 2023-01-25T12:23:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-01-25T12:23:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-01-25T12:23:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-01-25T12:23:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-01-25T12:23:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-01-25T12:23:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_scrub_interval": "300", 2023-01-25T12:23:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_scrub_max_keys": "100", 2023-01-25T12:23:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_scrub_timeout": "300", 2023-01-25T12:23:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_session_timeout": "300", 2023-01-25T12:23:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_smart_report_timeout": "5", 2023-01-25T12:23:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_stat_smooth_intervals": "6", 2023-01-25T12:23:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-01-25T12:23:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_stretch_pool_min_size": "2", 2023-01-25T12:23:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_stretch_pool_size": "4", 2023-01-25T12:23:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-01-25T12:23:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_subscribe_interval": "86400.000000", 2023-01-25T12:23:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_sync_debug": "false", 2023-01-25T12:23:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_sync_max_payload_keys": "2000", 2023-01-25T12:23:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_sync_max_payload_size": "1048576", 2023-01-25T12:23:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_sync_provider_kill_at": "0", 2023-01-25T12:23:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_sync_requester_kill_at": "0", 2023-01-25T12:23:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_sync_timeout": "60.000000", 2023-01-25T12:23:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_target_pg_per_osd": "100", 2023-01-25T12:23:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_tick_interval": "5", 2023-01-25T12:23:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_timecheck_interval": "300.000000", 2023-01-25T12:23:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-01-25T12:23:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_use_min_delay_socket": "false", 2023-01-25T12:23:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_older_version_delay": "604800", 2023-01-25T12:23:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-01-25T12:23:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-01-25T12:23:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-01-25T12:23:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_filestore_osds": "false", 2023-01-25T12:23:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-01-25T12:23:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-01-25T12:23:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-01-25T12:23:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_misplaced": "false", 2023-01-25T12:23:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-01-25T12:23:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_older_version": "true", 2023-01-25T12:23:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-01-25T12:23:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_pool_no_app": "true", 2023-01-25T12:23:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-01-25T12:23:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-01-25T12:23:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-01-25T12:23:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-01-25T12:23:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_on_too_few_osds": "false", 2023-01-25T12:23:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-01-25T12:23:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-01-25T12:23:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "monmap": "", 2023-01-25T12:23:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-01-25T12:23:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-01-25T12:23:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-01-25T12:23:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-01-25T12:23:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "motr_tracing_enabled": "false", 2023-01-25T12:23:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_op_threads": "3", 2023-01-25T12:23:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_buffer_size": "131072", 2023-01-25T12:23:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_cm": "false", 2023-01-25T12:23:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_device_name": "", 2023-01-25T12:23:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_dscp": "96", 2023-01-25T12:23:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-01-25T12:23:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_gid_idx": "0", 2023-01-25T12:23:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_local_gid": "", 2023-01-25T12:23:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_polling_us": "1000", 2023-01-25T12:23:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_port_num": "1", 2023-01-25T12:23:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-01-25T12:23:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-01-25T12:23:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_roce_ver": "1", 2023-01-25T12:23:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_send_buffers": "1024", 2023-01-25T12:23:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_sl": "3", 2023-01-25T12:23:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_support_srq": "true", 2023-01-25T12:23:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_rdma_type": "ib", 2023-01-25T12:23:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_async_reap_threshold": "5", 2023-01-25T12:23:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_before_connect": "false", 2023-01-25T12:23:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_ipv4": "true", 2023-01-25T12:23:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_ipv6": "false", 2023-01-25T12:23:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_msgr1": "true", 2023-01-25T12:23:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_msgr2": "false", 2023-01-25T12:23:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_port_max": "7568", 2023-01-25T12:23:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_port_min": "6800", 2023-01-25T12:23:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_prefer_ipv4": "false", 2023-01-25T12:23:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_retry_count": "3", 2023-01-25T12:23:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_bind_retry_delay": "5", 2023-01-25T12:23:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_blackhole_client": "false", 2023-01-25T12:23:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_blackhole_mds": "false", 2023-01-25T12:23:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_blackhole_mgr": "false", 2023-01-25T12:23:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_blackhole_mon": "false", 2023-01-25T12:23:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_blackhole_osd": "false", 2023-01-25T12:23:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_client_mode": "crc secure", 2023-01-25T12:23:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_cluster_mode": "crc secure", 2023-01-25T12:23:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_cluster_type": "", 2023-01-25T12:23:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_compress_secure": "false", 2023-01-25T12:23:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_connection_idle_timeout": "900", 2023-01-25T12:23:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_connection_ready_timeout": "10", 2023-01-25T12:23:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_crc_data": "true", 2023-01-25T12:23:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_crc_header": "true", 2023-01-25T12:23:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_die_on_bad_msg": "false", 2023-01-25T12:23:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_die_on_bug": "true", 2023-01-25T12:23:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_die_on_old_message": "true", 2023-01-25T12:23:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_die_on_skipped_message": "false", 2023-01-25T12:23:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_die_on_unhandled_msg": "false", 2023-01-25T12:23:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-01-25T12:23:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_coremask": "0xF", 2023-01-25T12:23:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-01-25T12:23:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_devs_allowlist": "", 2023-01-25T12:23:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_enable_tso": "true", 2023-01-25T12:23:20.850 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-01-25T12:23:20.850 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-01-25T12:23:20.850 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_hugepages": "", 2023-01-25T12:23:20.850 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_hw_flow_control": "true", 2023-01-25T12:23:20.850 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-01-25T12:23:20.850 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_lro": "true", 2023-01-25T12:23:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_memory_channel": "4", 2023-01-25T12:23:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-01-25T12:23:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_pmd": "", 2023-01-25T12:23:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_port_id": "0", 2023-01-25T12:23:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-01-25T12:23:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dump_corrupt_message_level": "1", 2023-01-25T12:23:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_dump_on_send": "false", 2023-01-25T12:23:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_initial_backoff": "0.200000", 2023-01-25T12:23:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_inject_delay_max": "1.000000", 2023-01-25T12:23:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_inject_delay_probability": "0.000000", 2023-01-25T12:23:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_inject_delay_type": "", 2023-01-25T12:23:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_inject_internal_delays": "0.000000", 2023-01-25T12:23:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_inject_network_congestion": "0", 2023-01-25T12:23:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_inject_socket_failures": "5000", 2023-01-25T12:23:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_learn_addr_from_peer": "true", 2023-01-25T12:23:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_max_accept_failures": "4", 2023-01-25T12:23:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_max_backoff": "15.000000", 2023-01-25T12:23:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_mon_client_mode": "secure crc", 2023-01-25T12:23:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_mon_cluster_mode": "secure crc", 2023-01-25T12:23:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_mon_service_mode": "secure crc", 2023-01-25T12:23:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_osd_compress_min_size": "1024", 2023-01-25T12:23:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_osd_compress_mode": "none", 2023-01-25T12:23:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_osd_compression_algorithm": "snappy zlib zstd lz4", 2023-01-25T12:23:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-01-25T12:23:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_pq_min_cost": "65536", 2023-01-25T12:23:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_public_type": "", 2023-01-25T12:23:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_service_mode": "crc secure", 2023-01-25T12:23:20.856 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_tcp_listen_backlog": "512", 2023-01-25T12:23:20.856 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_tcp_nodelay": "true", 2023-01-25T12:23:20.856 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-01-25T12:23:20.856 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_tcp_rcvbuf": "0", 2023-01-25T12:23:20.856 INFO:teuthology.orchestra.run.smithi117.stdout: "ms_type": "async", 2023-01-25T12:23:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: "no_config_file": "false", 2023-01-25T12:23:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter_completion_locks_per_session": "32", 2023-01-25T12:23:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter_debug_inject_relock_delay": "false", 2023-01-25T12:23:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter_inflight_op_bytes": "104857600", 2023-01-25T12:23:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter_inflight_ops": "1024", 2023-01-25T12:23:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter_inject_no_watch_ping": "false", 2023-01-25T12:23:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-01-25T12:23:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter_tick_interval": "5.000000", 2023-01-25T12:23:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter_timeout": "10.000000", 2023-01-25T12:23:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: "objectstore_blackhole": "false", 2023-01-25T12:23:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: "openssl_engine_opts": "", 2023-01-25T12:23:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_agent_delay_time": "5.000000", 2023-01-25T12:23:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_agent_hist_halflife": "1000", 2023-01-25T12:23:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_agent_max_low_ops": "2", 2023-01-25T12:23:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_agent_max_ops": "4", 2023-01-25T12:23:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-01-25T12:23:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_agent_quantize_effort": "0.100000", 2023-01-25T12:23:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_agent_slop": "0.020000", 2023-01-25T12:23:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-01-25T12:23:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_allow_recovery_below_min_size": "true", 2023-01-25T12:23:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_asio_thread_count": "2", 2023-01-25T12:23:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_async_recovery_min_cost": "1", 2023-01-25T12:23:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_auto_mark_unfound_lost": "false", 2023-01-25T12:23:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_backfill_retry_interval": "30.000000", 2023-01-25T12:23:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_backfill_scan_max": "512", 2023-01-25T12:23:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_backfill_scan_min": "64", 2023-01-25T12:23:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_backoff_on_degraded": "false", 2023-01-25T12:23:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_backoff_on_peering": "false", 2023-01-25T12:23:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_backoff_on_unfound": "true", 2023-01-25T12:23:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_beacon_report_interval": "300", 2023-01-25T12:23:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bench_duration": "30", 2023-01-25T12:23:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-01-25T12:23:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bench_max_block_size": "67108864", 2023-01-25T12:23:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bench_small_size_max_iops": "100", 2023-01-25T12:23:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_blkin_trace_all": "false", 2023-01-25T12:23:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_blocked_scrub_grace_period": "120", 2023-01-25T12:23:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-01-25T12:23:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-01-25T12:23:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-01-25T12:23:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_check_for_log_corruption": "false", 2023-01-25T12:23:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-01-25T12:23:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-01-25T12:23:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2023-01-25T12:23:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-01-25T12:23:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_class_update_on_start": "true", 2023-01-25T12:23:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_client_message_cap": "256", 2023-01-25T12:23:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_client_message_size_cap": "524288000", 2023-01-25T12:23:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_client_op_priority": "63", 2023-01-25T12:23:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_client_watch_timeout": "30", 2023-01-25T12:23:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_command_max_records": "256", 2023-01-25T12:23:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_compact_on_start": "false", 2023-01-25T12:23:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-01-25T12:23:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_crush_chooseleaf_type": "0", 2023-01-25T12:23:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_crush_initial_weight": "-1.000000", 2023-01-25T12:23:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_crush_update_on_start": "true", 2023-01-25T12:23:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_crush_update_weight_set": "true", 2023-01-25T12:23:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-01-25T12:23:20.868 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-01-25T12:23:20.868 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-01-25T12:23:20.868 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_drop_ping_duration": "0", 2023-01-25T12:23:20.868 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-01-25T12:23:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_feed_pullee": "-1", 2023-01-25T12:23:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-01-25T12:23:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-01-25T12:23:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-01-25T12:23:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_misdirected_ops": "false", 2023-01-25T12:23:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_no_acting_change": "false", 2023-01-25T12:23:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_no_purge_strays": "false", 2023-01-25T12:23:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_op_order": "false", 2023-01-25T12:23:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_pg_log_writeout": "false", 2023-01-25T12:23:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_pretend_recovery_active": "false", 2023-01-25T12:23:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-01-25T12:23:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-01-25T12:23:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_shutdown": "false", 2023-01-25T12:23:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-01-25T12:23:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-01-25T12:23:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_verify_cached_snaps": "false", 2023-01-25T12:23:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_verify_missing_on_start": "false", 2023-01-25T12:23:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_verify_snaps": "false", 2023-01-25T12:23:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-01-25T12:23:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-01-25T12:23:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_deep_scrub_keys": "1024", 2023-01-25T12:23:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-01-25T12:23:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-01-25T12:23:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-01-25T12:23:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_deep_scrub_stride": "524288", 2023-01-25T12:23:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-01-25T12:23:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_default_data_pool_replay_window": "5", 2023-01-25T12:23:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_default_notify_timeout": "30", 2023-01-25T12:23:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_delete_sleep": "0.000000", 2023-01-25T12:23:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-01-25T12:23:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-01-25T12:23:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-01-25T12:23:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_discard_disconnected_ops": "true", 2023-01-25T12:23:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_enable_op_tracker": "true", 2023-01-25T12:23:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-01-25T12:23:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_extblkdev_plugins": "vdo", 2023-01-25T12:23:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-01-25T12:23:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-01-25T12:23:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_fast_info": "true", 2023-01-25T12:23:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_fast_shutdown": "true", 2023-01-25T12:23:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-01-25T12:23:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_fast_shutdown_timeout": "15", 2023-01-25T12:23:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-01-25T12:23:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-01-25T12:23:20.877 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-01-25T12:23:20.877 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_function_tracing": "false", 2023-01-25T12:23:20.877 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_heartbeat_grace": "20", 2023-01-25T12:23:20.877 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_heartbeat_interval": "6", 2023-01-25T12:23:20.877 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-01-25T12:23:20.878 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_heartbeat_min_peers": "10", 2023-01-25T12:23:20.878 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_heartbeat_min_size": "2000", 2023-01-25T12:23:20.878 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_heartbeat_stale": "600", 2023-01-25T12:23:20.878 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-01-25T12:23:20.878 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_hit_set_max_size": "100000", 2023-01-25T12:23:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_hit_set_min_size": "1000", 2023-01-25T12:23:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-01-25T12:23:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-01-25T12:23:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-01-25T12:23:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-01-25T12:23:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-01-25T12:23:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_journal_flush_on_shutdown": "true", 2023-01-25T12:23:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_journal_size": "5120", 2023-01-25T12:23:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_kill_backfill_at": "0", 2023-01-25T12:23:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_loop_before_reset_tphandle": "64", 2023-01-25T12:23:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_map_cache_size": "50", 2023-01-25T12:23:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_map_dedup": "true", 2023-01-25T12:23:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_map_message_max": "40", 2023-01-25T12:23:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_map_message_max_bytes": "10485760", 2023-01-25T12:23:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_map_share_max_epochs": "40", 2023-01-25T12:23:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_attr_name_len": "100", 2023-01-25T12:23:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_attr_size": "0", 2023-01-25T12:23:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_backfills": "1", 2023-01-25T12:23:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_markdown_count": "5", 2023-01-25T12:23:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_markdown_period": "600", 2023-01-25T12:23:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_object_name_len": "2048", 2023-01-25T12:23:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_object_namespace_len": "256", 2023-01-25T12:23:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_object_size": "134217728", 2023-01-25T12:23:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-01-25T12:23:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_omap_entries_per_request": "1024", 2023-01-25T12:23:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_pg_blocked_by": "16", 2023-01-25T12:23:20.884 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_pg_log_entries": "10000", 2023-01-25T12:23:20.884 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-01-25T12:23:20.884 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_pgls": "1024", 2023-01-25T12:23:20.884 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_push_cost": "8388608", 2023-01-25T12:23:20.884 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_push_objects": "10", 2023-01-25T12:23:20.885 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_scrubs": "1", 2023-01-25T12:23:20.885 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-01-25T12:23:20.885 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_trimming_pgs": "2", 2023-01-25T12:23:20.885 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_write_op_reply_len": "64", 2023-01-25T12:23:20.885 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_max_write_size": "90", 2023-01-25T12:23:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_cost_per_byte_usec": "0.000000", 2023-01-25T12:23:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_cost_per_byte_usec_hdd": "2.600000", 2023-01-25T12:23:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_cost_per_byte_usec_ssd": "0.011000", 2023-01-25T12:23:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_cost_per_io_usec": "0.000000", 2023-01-25T12:23:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_cost_per_io_usec_hdd": "11400.000000", 2023-01-25T12:23:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_cost_per_io_usec_ssd": "50.000000", 2023-01-25T12:23:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-01-25T12:23:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-01-25T12:23:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-01-25T12:23:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-01-25T12:23:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-01-25T12:23:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_override_recovery_settings": "false", 2023-01-25T12:23:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_profile": "high_client_ops", 2023-01-25T12:23:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-01-25T12:23:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2023-01-25T12:23:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2023-01-25T12:23:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-01-25T12:23:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2023-01-25T12:23:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2023-01-25T12:23:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-01-25T12:23:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_client_lim": "999999", 2023-01-25T12:23:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_client_res": "1", 2023-01-25T12:23:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-01-25T12:23:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mclock_skip_benchmark": "false", 2023-01-25T12:23:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_memory_base": "805306368", 2023-01-25T12:23:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_memory_cache_min": "134217728", 2023-01-25T12:23:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-01-25T12:23:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-01-25T12:23:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_memory_target": "4294967296", 2023-01-25T12:23:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_memory_target_autotune": "false", 2023-01-25T12:23:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-01-25T12:23:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_min_pg_log_entries": "250", 2023-01-25T12:23:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_min_recovery_priority": "0", 2023-01-25T12:23:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mon_heartbeat_interval": "30", 2023-01-25T12:23:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-01-25T12:23:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mon_report_interval": "5", 2023-01-25T12:23:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mon_report_max_in_flight": "2", 2023-01-25T12:23:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-01-25T12:23:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_num_cache_shards": "32", 2023-01-25T12:23:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_num_op_tracker_shard": "32", 2023-01-25T12:23:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_numa_auto_affinity": "true", 2023-01-25T12:23:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_numa_node": "-1", 2023-01-25T12:23:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_numa_prefer_iface": "true", 2023-01-25T12:23:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-01-25T12:23:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_objecter_finishers": "1", 2023-01-25T12:23:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_objectstore": "bluestore", 2023-01-25T12:23:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_objectstore_fuse": "false", 2023-01-25T12:23:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_objectstore_tracing": "false", 2023-01-25T12:23:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_complaint_time": "30.000000", 2023-01-25T12:23:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_history_duration": "600", 2023-01-25T12:23:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_history_size": "20", 2023-01-25T12:23:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_history_slow_op_size": "20", 2023-01-25T12:23:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-01-25T12:23:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_log_threshold": "5", 2023-01-25T12:23:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_num_shards": "0", 2023-01-25T12:23:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_num_shards_hdd": "5", 2023-01-25T12:23:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_num_shards_ssd": "8", 2023-01-25T12:23:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_num_threads_per_shard": "0", 2023-01-25T12:23:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-01-25T12:23:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-01-25T12:23:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-01-25T12:23:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_pq_min_cost": "65536", 2023-01-25T12:23:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_queue": "mclock_scheduler", 2023-01-25T12:23:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_queue_cut_off": "high", 2023-01-25T12:23:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_thread_suicide_timeout": "150", 2023-01-25T12:23:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_op_thread_timeout": "15", 2023-01-25T12:23:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_open_classes_on_start": "true", 2023-01-25T12:23:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_os_flags": "0", 2023-01-25T12:23:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_peering_op_priority": "255", 2023-01-25T12:23:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_delete_cost": "1048576", 2023-01-25T12:23:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_delete_priority": "5", 2023-01-25T12:23:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-01-25T12:23:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-01-25T12:23:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_log_dups_tracked": "3000", 2023-01-25T12:23:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_log_trim_max": "10000", 2023-01-25T12:23:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_log_trim_min": "100", 2023-01-25T12:23:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-01-25T12:23:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_object_context_cache_count": "64", 2023-01-25T12:23:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pg_stat_report_interval_max": "500", 2023-01-25T12:23:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-01-25T12:23:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-01-25T12:23:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-01-25T12:23:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-01-25T12:23:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-01-25T12:23:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-01-25T12:23:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_crush_rule": "-1", 2023-01-25T12:23:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_ec_fast_read": "false", 2023-01-25T12:23:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-01-25T12:23:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_flag_bulk": "false", 2023-01-25T12:23:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-01-25T12:23:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_flag_nodelete": "false", 2023-01-25T12:23:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-01-25T12:23:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-01-25T12:23:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_flags": "0", 2023-01-25T12:23:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-01-25T12:23:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_min_size": "2", 2023-01-25T12:23:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-01-25T12:23:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_pg_num": "32", 2023-01-25T12:23:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_pgp_num": "0", 2023-01-25T12:23:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-01-25T12:23:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_size": "2", 2023-01-25T12:23:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_default_type": "replicated", 2023-01-25T12:23:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-01-25T12:23:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pool_use_gmt_hitset": "true", 2023-01-25T12:23:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_push_per_object_cost": "1000", 2023-01-25T12:23:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_read_ec_check_for_errors": "false", 2023-01-25T12:23:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recover_clone_overlap": "true", 2023-01-25T12:23:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recover_clone_overlap_limit": "10", 2023-01-25T12:23:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_cost": "20971520", 2023-01-25T12:23:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_delay_start": "0.000000", 2023-01-25T12:23:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_max_active": "0", 2023-01-25T12:23:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_max_active_hdd": "3", 2023-01-25T12:23:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_max_active_ssd": "10", 2023-01-25T12:23:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_max_chunk": "8388608", 2023-01-25T12:23:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-01-25T12:23:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_max_single_start": "1", 2023-01-25T12:23:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_op_priority": "3", 2023-01-25T12:23:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_op_warn_multiple": "16", 2023-01-25T12:23:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_priority": "5", 2023-01-25T12:23:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_retry_interval": "30.000000", 2023-01-25T12:23:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_sleep": "0.000000", 2023-01-25T12:23:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-01-25T12:23:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-01-25T12:23:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-01-25T12:23:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_repair_during_recovery": "false", 2023-01-25T12:23:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_requested_scrub_priority": "120", 2023-01-25T12:23:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-01-25T12:23:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_rollback_to_cluster_snap": "", 2023-01-25T12:23:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_auto_repair": "false", 2023-01-25T12:23:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-01-25T12:23:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-01-25T12:23:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_begin_hour": "0", 2023-01-25T12:23:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_begin_week_day": "0", 2023-01-25T12:23:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_chunk_max": "25", 2023-01-25T12:23:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_chunk_min": "5", 2023-01-25T12:23:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_cost": "52428800", 2023-01-25T12:23:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_during_recovery": "false", 2023-01-25T12:23:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_end_hour": "0", 2023-01-25T12:23:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_end_week_day": "0", 2023-01-25T12:23:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-01-25T12:23:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-01-25T12:23:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_invalid_stats": "true", 2023-01-25T12:23:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_load_threshold": "0.500000", 2023-01-25T12:23:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_scrub_max_interval": "604800.000000", 2